Jul 14 20:09:17 devstack cinder-volume[76540]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 20:09:17 devstack cinder-volume[76540]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 20:09:17 devstack cinder-volume[76540]: we strongly recommend against using it for new projects. Jul 14 20:09:17 devstack cinder-volume[76540]: If you are already using Eventlet, we recommend migrating to a different Jul 14 20:09:17 devstack cinder-volume[76540]: framework. For more detail see Jul 14 20:09:17 devstack cinder-volume[76540]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 20:09:17 devstack cinder-volume[76540]: import eventlet # noqa Jul 14 20:09:20 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:09:20 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:09:20 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:09:21 devstack cinder-volume[76540]: INFO dbcounter [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Registered counter for database cinder Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG oslo_db.sqlalchemy.engines [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG dbcounter [-] [76540] Writer thread running {{(pid=76540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:09:21 devstack cinder-volume[76540]: INFO cinder.rpc [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 20:09:21 devstack cinder-volume[76540]: INFO cinder.rpc [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG oslo_db.sqlalchemy.engines [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:09:21 devstack cinder-volume[76540]: INFO cinder.volume.manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Determined volume DB was empty at startup. Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG cinder.volume.manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76540) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 20:09:21 devstack cinder-volume[76540]: INFO cinder.volume.manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 20:09:21 devstack cinder-volume[76540]: WARNING stevedore.named [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 20:09:21 devstack cinder-volume[76540]: WARNING castellan.key_manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:09:21 devstack cinder-volume[76540]: WARNING cinder.keymgr.conf_key_mgr [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG cinder.volume.drivers.lvm [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76540) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 14 20:09:21 devstack cinder-volume[76540]: DEBUG oslo_concurrency.processutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_concurrency.processutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] CMD "cinder-rtstool verify" returned: 0 in 0.452s {{(pid=76540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_db.sqlalchemy.engines [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:09:22 devstack cinder-volume[76540]: INFO cinder.rpc [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 14 20:09:22 devstack cinder-volume[76540]: INFO cinder.rpc [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 14 20:09:22 devstack cinder-volume[76540]: WARNING stevedore.named [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 20:09:22 devstack cinder-volume[76540]: WARNING castellan.key_manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:09:22 devstack cinder-volume[76540]: INFO cinder.volume.manager [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_db.sqlalchemy.engines [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:09:22 devstack cinder-volume[76540]: INFO oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Starting 1 workers Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Started child 76682 {{(pid=76540) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Full set of CONF: {{(pid=76540) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] ******************************************************************************** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Configuration options gathered from: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] ================================================================================ {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] allow_availability_zone_fallback = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] allow_compression_on_image_upload = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] allowed_direct_url_schemes = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] api_rate_limit = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] auth_strategy = keystone {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] az_cache_duration = 3600 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_availability_zone = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_host = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_stats_polling_interval = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backup_api_class = cinder.backup.api.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backup_name_template = backup-%s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backup_use_same_host = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backup_use_temp_snapshot = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] chap_password = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] chap_username = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_internal_tenant_project_id = c1b120df23bd4666a3a17d8347cb89d8 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_internal_tenant_user_id = 87e97601e4df47bba27083e3a2403568 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cloned_volume_same_az = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cluster = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] compression_format = gzip {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] compute_api_class = cinder.compute.nova.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] config_dir = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] config_source = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] control_exchange = openstack {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] debug = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] default_availability_zone = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] default_group_type = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] default_volume_type = lvmdriver-1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] disk_geometry = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_client_cert = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_client_cert_key = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_data_namespace = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_ssl_cert_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_ssl_cert_verify = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] driver_use_ssl = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] enable_force_upload = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] enable_new_services = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] enable_unsupported_driver = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] enforce_multipath_for_image_xfer = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] filter_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_api_insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_api_ssl_compression = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_ca_certificates_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_catalog_info = image:glance:publicURL {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_num_retries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance_request_timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] goodness_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] graceful_shutdown_timeout = 5 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] group_api_class = cinder.group.api.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] host = devstack {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_compress_on_upload = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_conversion_address_space_limit = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_conversion_cpu_limit = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_conversion_disable = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_upload_use_cinder_backend = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_upload_use_internal_tenant = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_volume_cache_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_volume_cache_max_count = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] image_volume_cache_max_size_gb = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] init_host_max_objects_retrieval = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] instance_format = [instance: %(uuid)s] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iscsi_target_flags = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iscsi_write_cache = on {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iser_helper = tgtadm {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iser_ip_address = 192.168.122.128 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iser_port = 3260 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_color = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_config_append = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: INFO cinder.volume.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_dir = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_options = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_rotate_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_rotate_interval_type = days {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] log_rotation_type = none {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] max_age = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] max_logfile_count = 30 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] max_logfile_size_mb = 200 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] max_over_subscription_ratio = 20.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] message_reap_interval = 86400 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] message_ttl = 2592000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] migration_create_volume_timeout_secs = 300 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] monkey_patch = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] monkey_patch_modules = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] my_ip = 192.168.122.128 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] no_snapshot_gb_quota = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] num_iser_scan_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] num_shell_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] num_volume_device_scan_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] nvmeof_conn_info_version = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] nvmet_ns_id = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] nvmet_port_id = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_max_limit = 1000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_ext_list = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_listen_port = 8776 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_use_ssl = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] osapi_volume_workers = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] per_volume_size_limit = -1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] periodic_fuzzy_delay = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] periodic_interval = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] public_endpoint = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] publish_errors = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_backup_gigabytes = 1000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_backups = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_gigabytes = 1000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_groups = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_snapshots = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] quota_volumes = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] rate_limit_burst = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] rate_limit_except_level = CRITICAL {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] rate_limit_interval = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] reinit_driver_count = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] replication_device = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] report_discard_supported = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] report_interval = 120 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] reservation_clean_interval = 86400 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] reservation_expire = 86400 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] reserved_image_namespaces = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] reserved_percentage = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] rpc_response_timeout = 120 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] run_external_periodic_tasks = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] scst_target_driver = iscsi {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] scst_target_iqn_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_down_time = 720 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] shell_completion = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] snapshot_name_template = snapshot-%s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] snapshot_same_host = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] split_loggers = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] state_path = /opt/stack/data/cinder {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] storage_availability_zone = nova {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] storage_protocol = iSCSI {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] syslog_log_facility = LOG_USER {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_helper = lioadm {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_ip_address = 192.168.122.128 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_port = 3260 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_protocol = iscsi {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] target_secondary_ip_addresses = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] trace_flags = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] transport_url = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] until_refresh = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_chap_auth = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_default_quota_class = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_journal = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_json = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_multipath_for_image_xfer = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_stderr = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] use_syslog = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] verify_glance_signatures = enabled {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_api_class = cinder.volume.api.API {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_backend_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_clear = zero {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_clear_ionice = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_clear_size = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_copy_bps_limit = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_dd_blocksize = 1M {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_name_template = volume-%s {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_service_inithost_offload = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volume_usage_audit_period = month {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] zoning_mode = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_concurrency.disable_process_locking = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.auth_section = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.auth_type = password {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.auth_version = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.cache = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.include_service_catalog = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.interface = public {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_password = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcache_username = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.region_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.service_type = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.backend = dogpile.cache.null {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.backend_argument = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.backend_expiration_time = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.config_prefix = cache.oslo {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.debug_cache_backend = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.enable_retry_client = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.enable_socket_keepalive = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.expiration_time = 600 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.hashclient_retry_attempts = 2 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_dead_retry = 300 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_pool_maxsize = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_sasl_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.password = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.proxies = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.redis_db = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.redis_server = localhost:6379 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.retry_attempts = 2 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.retry_delay = 0.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.socket_keepalive_count = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.socket_keepalive_idle = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.socket_keepalive_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.socket_timeout = 1.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.tls_allowed_ciphers = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.tls_cafile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.tls_certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.tls_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.tls_keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cache.username = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] coordination.backend_url = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.asyncio_connection = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.asyncio_slave_connection = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.backend = sqlalchemy {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.connection = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.connection_debug = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.connection_parameters = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.connection_recycle_time = 3600 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.connection_trace = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.db_inc_retry_interval = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.db_max_retries = 20 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.db_max_retry_interval = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.db_retry_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.max_overflow = 50 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.max_pool_size = 5 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.max_retries = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.mysql_wsrep_sync_wait = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.pool_timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.retry_interval = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.slave_connection = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.sqlite_synchronous = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack sudo[76686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.synchronous_reader = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] database.use_db_reconnect = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack sudo[76686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.connection_string = messaging:// {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.es_doc_type = notification {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.es_scroll_size = 10000 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.es_scroll_time = 2m {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.filter_error_trace = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.hmac_keys = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.sentinel_service_name = mymaster {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.socket_timeout = 0.1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.trace_requests = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler.trace_sqlalchemy = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler_jaeger.process_tags = {} {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler_jaeger.service_name_prefix = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] profiler_otlp.service_name_prefix = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.enforce_new_defaults = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.enforce_scope = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.policy_default_rule = default {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.policy_file = policy.yaml {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.group = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.helper_command = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] privsep_osbrick.user = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.group = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.helper_command = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] cinder_sys_admin.user = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.auth_section = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.auth_type = password {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.cafile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.collect_timing = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.send_service_user_token = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.split_loggers = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] service_user.timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.auth_section = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.auth_type = password {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.collect_timing = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.region_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.split_loggers = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] glance.timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.backend_availability_zone = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.chap_password = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.chap_username = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.disk_geometry = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_client_cert = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_client_cert_key = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_data_namespace = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.driver_use_ssl = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.extra_capabilities = {} {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.filter_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.goodness_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iscsi_target_flags = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iscsi_write_cache = on {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iser_helper = tgtadm {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iser_port = 3260 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.lvm_share_target = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.lvm_type = auto {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.num_shell_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.replication_device = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.report_discard_supported = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.reserved_percentage = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_helper = tgtadm {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_port = 3260 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_protocol = iscsi {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.trace_flags = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.unique_fqdn_network = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.use_chap_auth = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_backend_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_clear = zero {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_clear_ionice = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_clear_size = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_reports.file_event_handler = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_reports.log_dir = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.backend_host = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.chap_password = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.chap_username = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.disk_geometry = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_client_cert = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.extra_capabilities = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.filter_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.goodness_function = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iser_helper = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iser_ip_address = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iser_port = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.lvm_share_target = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.lvm_type = auto {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.num_shell_tries = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.replication_device = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.report_discard_supported = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.reserved_percentage = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.scst_target_driver = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.storage_protocol = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_helper = lioadm {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_ip_address = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_port = 3260 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.trace_flags = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.use_chap_auth = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_clear = zero {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_clear_size = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] lvmdriver-1.volumes_dir = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_notifications.driver = [] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_notifications.retry = -1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] key_manager.fixed_key = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.barbican_api_version = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.barbican_endpoint = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.barbican_endpoint_type = public {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.barbican_region_name = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.cafile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.collect_timing = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.number_of_retries = 60 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.retry_delay = 1 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.send_service_user_token = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.split_loggers = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.verify_ssl = True {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican.verify_ssl_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.auth_section = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.auth_type = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.cafile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.certfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.collect_timing = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.insecure = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.keyfile = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.split_loggers = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] barbican_service_user.timeout = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.approle_role_id = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.approle_secret_id = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.auth_method = approle {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.auth_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.kv_mountpoint = secret {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.kv_path = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.kv_version = 2 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.namespace = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.root_token_id = **** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.ssl_ca_crt_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.timeout = 60.0 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.token_file = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.token_role = None {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.use_ssl = False {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:09:22 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] ******************************************************************************** {{(pid=76540) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 20:09:22 devstack sudo[76686]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:22 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:22 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:22 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:23 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.317s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:09:23 devstack cinder-volume[76682]: INFO cinder.brick.local_dev.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:23 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:23 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:23 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG cinder.brick.local_dev.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76682) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 14 20:09:23 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:23 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:23 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:24 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:24 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:24 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:24 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:24 devstack sudo[77093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 14 20:09:24 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:24 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.283s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:24 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:24 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:24 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:25 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:25 devstack sudo[77299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:25 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:25 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:25 devstack sudo[77302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:25 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:25 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:25 devstack sudo[77385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:25 devstack sudo[77385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:25 devstack sudo[77385]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:25 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:25 devstack sudo[77389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:25 devstack sudo[77389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:26 devstack sudo[77389]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:26 devstack cinder-volume[76682]: INFO cinder.volume.drivers.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:26 devstack sudo[77479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:26 devstack sudo[77479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:26 devstack sudo[77479]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:26 devstack sudo[77482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:26 devstack sudo[77482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:26 devstack sudo[77482]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:26 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:26 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:26 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:27 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:27 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:27 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:27 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:27 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:27 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:27 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:27 devstack cinder-volume[76682]: INFO cinder.volume.driver [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG cinder.volume.driver [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76682) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_db.sqlalchemy.engines [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writer thread running {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG cinder.db.api [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Building query based on filter {{(pid=76682) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG cinder.image.image_utils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76682) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 20:09:27 devstack cinder-volume[76682]: INFO cinder.keymgr.migration [None req-681c2e8f-b2cf-46a9-8bb2-c8e8bb016b90 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:09:27 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:27 devstack sudo[77495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:27 devstack sudo[77495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:28 devstack sudo[77495]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:28 devstack sudo[77498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:28 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:28 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:28 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:28 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:28 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:28 devstack sudo[77512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:28 devstack sudo[77512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:28 devstack sudo[77512]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG cinder.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Notifying Schedulers of capabilities ... {{(pid=76682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:09:28 devstack cinder-volume[76682]: INFO cinder.volume.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Driver initialization completed successfully. Jul 14 20:09:28 devstack cinder-volume[76682]: INFO cinder.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Initiating service 2 cleanup Jul 14 20:09:28 devstack cinder-volume[76682]: INFO cinder.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Service 2 cleanup completed. Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG cinder.service [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Creating RPC server for service cinder-volume {{(pid=76682) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 20:09:28 devstack cinder-volume[76682]: DEBUG cinder.service [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76682) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 20:09:29 devstack cinder-volume[76682]: INFO cinder.volume.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:29 devstack sudo[77515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:09:29 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:29 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:29 devstack sudo[77518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:29 devstack sudo[77518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:29 devstack sudo[77518]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:29 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:09:29 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:29 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:29 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:09:29 devstack sudo[77526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:09:29 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:09:30 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root Jul 14 20:09:30 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:09:30 devstack cinder-volume[76682]: INFO cinder.volume.manager [None req-e1289cac-43b0-414e-bb50-6f4a7d66b532 None None] Driver post RPC initialization completed successfully. Jul 14 20:09:32 devstack cinder-volume[76540]: DEBUG dbcounter [-] [76540] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:09:38 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:09:40 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:09:50 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager._thread_info {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:09:50 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread count: 6 {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:09:50 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread info: [<_MainThread(MainThread, started 124652665766016)>, , , , , ] {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:10:50 devstack sudo[79271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:10:50 devstack sudo[79271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:10:50 devstack sudo[79271]: pam_unix(sudo:session): session closed for user root Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:10:50 devstack sudo[79274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:10:50 devstack sudo[79274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:10:50 devstack sudo[79274]: pam_unix(sudo:session): session closed for user root Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:10:50 devstack sudo[79277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:10:50 devstack sudo[79277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:10:50 devstack sudo[79277]: pam_unix(sudo:session): session closed for user root Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:10:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:10:50 devstack sudo[79281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:10:50 devstack sudo[79281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:10:51 devstack sudo[79281]: pam_unix(sudo:session): session closed for user root Jul 14 20:10:51 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:10:51 devstack cinder-volume[76682]: DEBUG cinder.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Notifying Schedulers of capabilities ... {{(pid=76682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:10:51 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager._thread_info {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:10:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread count: 6 {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:10:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread info: [<_MainThread(MainThread, started 124652665766016)>, , , , , ] {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:11:40 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:SELECT=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:11:40 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:UPDATE=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:11:50 devstack sudo[82797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:11:50 devstack sudo[82797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:11:50 devstack sudo[82797]: pam_unix(sudo:session): session closed for user root Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:11:50 devstack sudo[82800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:11:50 devstack sudo[82800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:11:50 devstack sudo[82800]: pam_unix(sudo:session): session closed for user root Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:11:50 devstack sudo[82803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:11:50 devstack sudo[82803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:11:50 devstack sudo[82803]: pam_unix(sudo:session): session closed for user root Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:11:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:11:50 devstack sudo[82806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:11:50 devstack sudo[82806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:11:51 devstack sudo[82806]: pam_unix(sudo:session): session closed for user root Jul 14 20:11:51 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.232s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:11:51 devstack cinder-volume[76682]: DEBUG cinder.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Notifying Schedulers of capabilities ... {{(pid=76682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:12:50 devstack sudo[84484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:12:50 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:12:50 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:12:50 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:12:50 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:12:50 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:12:50 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:12:50 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:12:50 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:12:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:12:50 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:12:50 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:12:51 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Jul 14 20:12:51 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:12:51 devstack cinder-volume[76682]: DEBUG cinder.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Notifying Schedulers of capabilities ... {{(pid=76682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:12:51 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager._thread_info {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:12:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread count: 6 {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:12:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread info: [<_MainThread(MainThread, started 124652665766016)>, , , , , ] {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:13:40 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:SELECT=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:13:40 devstack cinder-volume[76682]: DEBUG dbcounter [-] [76682] Writing DB stats cinder:UPDATE=1 {{(pid=76682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG cinder.volume.drivers.lvm [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Updating volume stats {{(pid=76682) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:13:50 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 20:13:50 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:13:50 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:13:50 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:13:50 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:13:50 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:13:50 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 20:13:50 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:13:50 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:13:50 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:13:50 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 20:13:50 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:13:51 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Jul 14 20:13:51 devstack cinder-volume[76682]: DEBUG oslo_concurrency.processutils [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:13:51 devstack cinder-volume[76682]: DEBUG cinder.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Notifying Schedulers of capabilities ... {{(pid=76682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:13:51 devstack cinder-volume[76682]: DEBUG oslo_service.periodic_task [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] Running periodic task VolumeManager._thread_info {{(pid=76682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:13:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread count: 6 {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:13:51 devstack cinder-volume[76682]: DEBUG cinder.volume.manager [None req-d761349c-f429-4c48-9d70-3c75f6650390 None None] thread info: [<_MainThread(MainThread, started 124652665766016)>, , , , , ] {{(pid=76682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:14:30 devstack cinder-volume[76540]: INFO oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Caught SIGTERM, stopping children Jul 14 20:14:30 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Acquiring lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:30 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Acquired lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:30 devstack cinder-volume[76540]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Releasing lock "singleton_lock" {{(pid=76540) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:30 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Stop services. {{(pid=76540) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 20:14:30 devstack cinder-volume[76540]: DEBUG oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Killing children. {{(pid=76540) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 20:14:30 devstack cinder-volume[76540]: INFO oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Waiting on 1 children to exit Jul 14 20:14:34 devstack cinder-volume[76682]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Acquiring lock "singleton_lock" {{(pid=76682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:34 devstack cinder-volume[76682]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Acquired lock "singleton_lock" {{(pid=76682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:34 devstack cinder-volume[76682]: DEBUG oslo_concurrency.lockutils [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Releasing lock "singleton_lock" {{(pid=76682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:34 devstack cinder-volume[76682]: WARNING amqp [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 20:14:34 devstack cinder-volume[76682]: WARNING amqp [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 20:14:34 devstack cinder-volume[76540]: INFO oslo_service.backend._eventlet.service [None req-b667e726-8b07-4596-ad5c-d43473cb7127 None None] Child 76682 exited with status 0 Jul 14 20:14:34 devstack cinder-volume[86783]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 20:14:34 devstack cinder-volume[86783]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 20:14:34 devstack cinder-volume[86783]: we strongly recommend against using it for new projects. Jul 14 20:14:34 devstack cinder-volume[86783]: If you are already using Eventlet, we recommend migrating to a different Jul 14 20:14:34 devstack cinder-volume[86783]: framework. For more detail see Jul 14 20:14:34 devstack cinder-volume[86783]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 20:14:34 devstack cinder-volume[86783]: import eventlet # noqa Jul 14 20:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:37 devstack cinder-volume[86783]: INFO dbcounter [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Registered counter for database cinder Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_db.sqlalchemy.engines [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writer thread running {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:14:37 devstack cinder-volume[86783]: INFO cinder.rpc [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 20:14:37 devstack cinder-volume[86783]: INFO cinder.rpc [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_db.sqlalchemy.engines [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Determined volume DB was empty at startup. Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86783) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 20:14:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 20:14:37 devstack cinder-volume[86783]: WARNING stevedore.named [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 20:14:37 devstack cinder-volume[86783]: WARNING castellan.key_manager [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:14:37 devstack cinder-volume[86783]: WARNING cinder.keymgr.conf_key_mgr [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:14:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_db.sqlalchemy.engines [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:37 devstack cinder-volume[86783]: INFO oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Starting 1 workers Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Started child 86997 {{(pid=86783) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Full set of CONF: {{(pid=86783) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] ******************************************************************************** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Configuration options gathered from: {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] ================================================================================ {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] allow_availability_zone_fallback = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] allow_compression_on_image_upload = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] allowed_direct_url_schemes = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] api_rate_limit = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] auth_strategy = keystone {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_availability_zone = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_host = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86997]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_stats_polling_interval = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backup_api_class = cinder.backup.api.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backup_name_template = backup-%s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backup_use_same_host = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backup_use_temp_snapshot = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] chap_password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] chap_username = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_internal_tenant_project_id = c1b120df23bd4666a3a17d8347cb89d8 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_internal_tenant_user_id = 87e97601e4df47bba27083e3a2403568 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cluster = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] compression_format = gzip {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] compute_api_class = cinder.compute.nova.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] config_dir = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] config_source = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] control_exchange = openstack {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] debug = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] default_availability_zone = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] default_group_type = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] default_volume_type = QuobyteHD {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] disk_geometry = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_client_cert = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_client_cert_key = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_data_namespace = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_ssl_cert_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_ssl_cert_verify = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] driver_use_ssl = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] enable_new_services = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] enable_unsupported_driver = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] enabled_backends = ['QuobyteHD'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] enforce_multipath_for_image_xfer = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] filter_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_api_insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_api_ssl_compression = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_ca_certificates_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_catalog_info = image:glance:publicURL {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_num_retries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance_request_timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] goodness_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] graceful_shutdown_timeout = 5 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] group_api_class = cinder.group.api.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] host = devstack {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_compress_on_upload = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_conversion_address_space_limit = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_conversion_cpu_limit = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_conversion_disable = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_upload_use_cinder_backend = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_upload_use_internal_tenant = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_volume_cache_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_volume_cache_max_count = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] image_volume_cache_max_size_gb = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] init_host_max_objects_retrieval = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] instance_format = [instance: %(uuid)s] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iscsi_target_flags = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iscsi_write_cache = on {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iser_helper = tgtadm {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iser_ip_address = 192.168.122.128 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iser_port = 3260 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_color = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_config_append = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_dir = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_options = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_rotate_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_rotate_interval_type = days {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] log_rotation_type = none {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] max_age = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] max_logfile_count = 30 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] max_logfile_size_mb = 200 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] max_over_subscription_ratio = 20.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] message_reap_interval = 86400 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] message_ttl = 2592000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] migration_create_volume_timeout_secs = 300 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] monkey_patch = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] monkey_patch_modules = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] my_ip = 192.168.122.128 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] no_snapshot_gb_quota = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] num_iser_scan_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] num_shell_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] num_volume_device_scan_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] nvmeof_conn_info_version = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] nvmet_ns_id = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] nvmet_port_id = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_max_limit = 1000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_ext_list = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_listen_port = 8776 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_use_ssl = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] osapi_volume_workers = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] per_volume_size_limit = -1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] periodic_fuzzy_delay = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] periodic_interval = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] public_endpoint = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] publish_errors = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_backup_gigabytes = 1000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_backups = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_gigabytes = 1000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_groups = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_snapshots = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] quota_volumes = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] rate_limit_burst = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] rate_limit_except_level = CRITICAL {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] rate_limit_interval = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] reinit_driver_count = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] replication_device = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] report_discard_supported = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] report_interval = 120 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] reservation_clean_interval = 86400 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] reservation_expire = 86400 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] reserved_image_namespaces = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] reserved_percentage = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] rpc_response_timeout = 120 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] run_external_periodic_tasks = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] scst_target_driver = iscsi {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] scst_target_iqn_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_down_time = 720 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] shell_completion = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] snapshot_name_template = snapshot-%s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] split_loggers = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] state_path = /opt/stack/data/cinder {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.remotefs [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86997) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] storage_availability_zone = nova {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] storage_protocol = iSCSI {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] syslog_log_facility = LOG_USER {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_helper = lioadm {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_ip_address = 192.168.122.128 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_port = 3260 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_protocol = iscsi {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] target_secondary_ip_addresses = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] trace_flags = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] transport_url = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] until_refresh = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_chap_auth = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_default_quota_class = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_journal = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_json = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_multipath_for_image_xfer = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_stderr = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] use_syslog = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] verify_glance_signatures = enabled {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_api_class = cinder.volume.api.API {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_backend_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_clear = zero {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_clear_ionice = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_clear_size = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_copy_bps_limit = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_dd_blocksize = 1M {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_name_template = volume-%s {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_service_inithost_offload = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volume_usage_audit_period = month {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] zoning_mode = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_concurrency.disable_process_locking = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.auth_section = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.auth_type = password {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.auth_version = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.cache = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.include_service_catalog = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.interface = public {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_password = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcache_username = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.region_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.service_type = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.backend = dogpile.cache.null {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.backend_argument = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.backend_expiration_time = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.config_prefix = cache.oslo {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.debug_cache_backend = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.enable_retry_client = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.enable_socket_keepalive = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.expiration_time = 600 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.hashclient_retry_attempts = 2 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_dead_retry = 300 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_pool_maxsize = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:37 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_sasl_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.proxies = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.redis_db = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.redis_server = localhost:6379 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.retry_attempts = 2 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.retry_delay = 0.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.socket_keepalive_count = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.socket_keepalive_idle = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.socket_keepalive_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.socket_timeout = 1.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.tls_allowed_ciphers = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.tls_cafile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.tls_certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.tls_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.tls_keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cache.username = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] coordination.backend_url = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.asyncio_connection = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.asyncio_slave_connection = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.backend = sqlalchemy {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.connection = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.connection_debug = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.connection_parameters = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.connection_recycle_time = 3600 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.connection_trace = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.db_inc_retry_interval = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.db_max_retries = 20 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.db_max_retry_interval = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.db_retry_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.max_overflow = 50 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.max_pool_size = 5 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.max_retries = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.mysql_wsrep_sync_wait = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.pool_timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.retry_interval = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.slave_connection = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.sqlite_synchronous = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.synchronous_reader = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] database.use_db_reconnect = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.connection_string = messaging:// {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.es_doc_type = notification {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.es_scroll_size = 10000 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.es_scroll_time = 2m {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.filter_error_trace = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.hmac_keys = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.sentinel_service_name = mymaster {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.socket_timeout = 0.1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.trace_requests = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler.trace_sqlalchemy = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler_jaeger.process_tags = {} {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler_jaeger.service_name_prefix = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] profiler_otlp.service_name_prefix = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.enforce_new_defaults = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.enforce_scope = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.policy_default_rule = default {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.policy_file = policy.yaml {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.group = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.helper_command = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] privsep_osbrick.user = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.group = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.helper_command = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] cinder_sys_admin.user = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.auth_section = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.auth_type = password {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.cafile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.collect_timing = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.send_service_user_token = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.split_loggers = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] service_user.timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.auth_section = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.auth_type = password {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.collect_timing = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.region_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.split_loggers = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] glance.timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.backend_availability_zone = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.chap_password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.chap_username = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.disk_geometry = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_client_cert = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_client_cert_key = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_data_namespace = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.driver_use_ssl = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.extra_capabilities = {} {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.filter_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.goodness_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iscsi_target_flags = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iscsi_write_cache = on {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iser_helper = tgtadm {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iser_port = 3260 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_host = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_login = admin {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_mount_options = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_private_key = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_share_path = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.num_shell_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.quobyte_volume_url = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.replication_device = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.report_discard_supported = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.reserved_percentage = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_helper = tgtadm {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_port = 3260 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_protocol = iscsi {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.trace_flags = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.unique_fqdn_network = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.use_chap_auth = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_backend_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_clear = zero {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_clear_ionice = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_clear_size = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_reports.file_event_handler = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_reports.log_dir = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.backend_availability_zone = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.backend_host = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.chap_password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.chap_username = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.chiscsi_conf = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.disk_geometry = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_client_cert = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_data_namespace = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.driver_use_ssl = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.extra_capabilities = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.filter_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.goodness_function = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iser_helper = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iser_ip_address = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iser_port = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.iser_target_prefix = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_host = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_login = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_mount_options = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_password = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_private_key = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_share_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_ssh_port = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.num_shell_tries = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.nvmet_port_id = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.replication_device = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.report_discard_supported = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.reserved_percentage = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.scst_target_driver = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.storage_protocol = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_helper = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_ip_address = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_port = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_prefix = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_protocol = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.trace_flags = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.use_chap_auth = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_clear = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_clear_size = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] QuobyteHD.volumes_dir = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86997) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86997]: WARNING cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86997]: WARNING cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_notifications.driver = [] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Running cmd (subprocess): mount.quobyte {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_notifications.retry = -1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] key_manager.fixed_key = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.barbican_api_version = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.barbican_endpoint = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.barbican_endpoint_type = public {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.barbican_region_name = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.cafile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.collect_timing = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.number_of_retries = 60 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.retry_delay = 1 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.send_service_user_token = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.split_loggers = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.verify_ssl = True {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican.verify_ssl_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.auth_section = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.auth_type = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.cafile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.certfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.collect_timing = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.insecure = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.keyfile = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.split_loggers = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] barbican_service_user.timeout = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.approle_role_id = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.approle_secret_id = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.auth_method = approle {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.auth_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.kv_mountpoint = secret {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.kv_path = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.kv_version = 2 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.namespace = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.root_token_id = **** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.ssl_ca_crt_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.timeout = 60.0 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.token_file = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.token_role = None {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.use_ssl = False {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:38 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] ******************************************************************************** {{(pid=86783) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 20:14:38 devstack quobyte-client[87002]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 20:14:38 devstack quobyte-client[87002]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=86997) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:38 devstack cinder-volume[86997]: INFO cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc ... Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf -c /etc/quobyte/client-cinder.cfg {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:38 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf -c /etc/quobyte/client-cinder.cfg Jul 14 20:14:38 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:38 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:38 devstack cinder-volume[86997]: INFO cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc succeeded Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=86997) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:38 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:38 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:38 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.247s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:38 devstack cinder-volume[86997]: INFO cinder.volume.driver [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Driver hasn't implemented _init_vendor_properties() Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG cinder.volume.driver [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86997) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG oslo_db.sqlalchemy.engines [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG dbcounter [-] [86997] Writer thread running {{(pid=86997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:14:38 devstack cinder-volume[86997]: DEBUG cinder.db.api [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Building query based on filter {{(pid=86997) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.image.image_utils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86997) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.keymgr.migration [None req-e72980cc-a105-451d-b316-ed9d4f38499c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=86997) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=86997) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:39 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:39 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:39 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.229s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Notifying Schedulers of capabilities ... {{(pid=86997) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Driver initialization completed successfully. Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Initiating service 3 cleanup Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Service 3 cleanup completed. Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.service [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Creating RPC server for service cinder-volume {{(pid=86997) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.service [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86997) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=86997) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=86997) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:39 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:39 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:39 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:39 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.250s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:39 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-46156f9e-365b-46ec-9d65-c075bf29cd2f None None] Driver post RPC initialization completed successfully. Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=86997) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG cinder.volume.drivers.quobyte [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=86997) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86997) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:44 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:44 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:44 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG oslo_concurrency.processutils [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.234s {{(pid=86997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:44 devstack cinder-volume[86997]: DEBUG cinder.manager [None req-8159516a-4c4c-44ce-946c-3a3e1eedea7d None None] Notifying Schedulers of capabilities ... {{(pid=86997) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:14:45 devstack cinder-volume[86783]: INFO oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Caught SIGTERM, stopping children Jul 14 20:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Acquiring lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Acquired lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Releasing lock "singleton_lock" {{(pid=86783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:45 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Stop services. {{(pid=86783) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 20:14:45 devstack cinder-volume[86783]: DEBUG oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Killing children. {{(pid=86783) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 20:14:45 devstack cinder-volume[86783]: INFO oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Waiting on 1 children to exit Jul 14 20:14:47 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Acquiring lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:47 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Acquired lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:47 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Releasing lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:47 devstack cinder-volume[86997]: WARNING amqp [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 20:14:47 devstack cinder-volume[86997]: WARNING amqp [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 20:14:47 devstack cinder-volume[86783]: INFO oslo_service.backend._eventlet.service [None req-aaff2540-35ae-4ac9-bcf8-f64895623b97 None None] Child 86997 exited with status 0 Jul 14 20:14:48 devstack cinder-volume[87309]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 20:14:48 devstack cinder-volume[87309]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 20:14:48 devstack cinder-volume[87309]: we strongly recommend against using it for new projects. Jul 14 20:14:48 devstack cinder-volume[87309]: If you are already using Eventlet, we recommend migrating to a different Jul 14 20:14:48 devstack cinder-volume[87309]: framework. For more detail see Jul 14 20:14:48 devstack cinder-volume[87309]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 20:14:48 devstack cinder-volume[87309]: import eventlet # noqa Jul 14 20:14:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 20:14:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 20:14:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 20:14:52 devstack cinder-volume[87309]: INFO dbcounter [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Registered counter for database cinder Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writer thread running {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:14:52 devstack cinder-volume[87309]: INFO cinder.rpc [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 20:14:52 devstack cinder-volume[87309]: INFO cinder.rpc [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Determined volume DB was empty at startup. Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87309) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 20:14:52 devstack cinder-volume[87309]: WARNING stevedore.named [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 20:14:52 devstack cinder-volume[87309]: WARNING castellan.key_manager [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:14:52 devstack cinder-volume[87309]: WARNING cinder.keymgr.conf_key_mgr [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 20:14:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:52 devstack cinder-volume[87309]: INFO oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Starting 1 workers Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Started child 87600 {{(pid=87309) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 20:14:52 devstack cinder-volume[87600]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Full set of CONF: {{(pid=87309) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] ******************************************************************************** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] Configuration options gathered from: {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] ================================================================================ {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] allow_availability_zone_fallback = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] allow_compression_on_image_upload = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] allowed_direct_url_schemes = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] api_rate_limit = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] auth_strategy = keystone {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_availability_zone = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_host = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_stats_polling_interval = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backup_api_class = cinder.backup.api.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backup_name_template = backup-%s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backup_use_same_host = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backup_use_temp_snapshot = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] chap_password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] chap_username = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_internal_tenant_project_id = c1b120df23bd4666a3a17d8347cb89d8 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_internal_tenant_user_id = 87e97601e4df47bba27083e3a2403568 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cluster = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] compression_format = gzip {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] compute_api_class = cinder.compute.nova.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] config_dir = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] config_source = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] control_exchange = openstack {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] debug = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] default_availability_zone = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] default_group_type = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] default_volume_type = QuobyteHD {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] disk_geometry = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_client_cert = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_client_cert_key = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_data_namespace = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_ssl_cert_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_ssl_cert_verify = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] driver_use_ssl = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] enable_new_services = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] enable_unsupported_driver = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] enabled_backends = ['QuobyteHD'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] enforce_multipath_for_image_xfer = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] filter_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_api_insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_api_ssl_compression = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_ca_certificates_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_catalog_info = image:glance:publicURL {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_num_retries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance_request_timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] goodness_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] graceful_shutdown_timeout = 5 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] group_api_class = cinder.group.api.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] host = devstack {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_compress_on_upload = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_conversion_address_space_limit = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_conversion_cpu_limit = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_conversion_disable = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_upload_use_cinder_backend = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_upload_use_internal_tenant = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_volume_cache_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_volume_cache_max_count = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] image_volume_cache_max_size_gb = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] init_host_max_objects_retrieval = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] instance_format = [instance: %(uuid)s] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iscsi_target_flags = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iscsi_write_cache = on {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iser_helper = tgtadm {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iser_ip_address = 192.168.122.128 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iser_port = 3260 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_color = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_config_append = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_dir = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_options = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_rotate_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_rotate_interval_type = days {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 20:14:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87600) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] log_rotation_type = none {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] max_age = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] max_logfile_count = 30 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] max_logfile_size_mb = 200 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] max_over_subscription_ratio = 20.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] message_reap_interval = 86400 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] message_ttl = 2592000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] migration_create_volume_timeout_secs = 300 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] monkey_patch = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] monkey_patch_modules = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] my_ip = 192.168.122.128 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] no_snapshot_gb_quota = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] num_iser_scan_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] num_shell_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] num_volume_device_scan_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] nvmeof_conn_info_version = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] nvmet_ns_id = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] nvmet_port_id = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_max_limit = 1000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_ext_list = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_listen_port = 8776 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_use_ssl = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] osapi_volume_workers = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] per_volume_size_limit = -1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] periodic_fuzzy_delay = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] periodic_interval = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] public_endpoint = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] publish_errors = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_backup_gigabytes = 1000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_backups = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_gigabytes = 1000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_groups = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_snapshots = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] quota_volumes = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] rate_limit_burst = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:52 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] rate_limit_except_level = CRITICAL {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] rate_limit_interval = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] reinit_driver_count = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] replication_device = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] report_discard_supported = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] report_interval = 120 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] reservation_clean_interval = 86400 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] reservation_expire = 86400 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] reserved_image_namespaces = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] reserved_percentage = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] rpc_response_timeout = 120 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] run_external_periodic_tasks = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] scst_target_driver = iscsi {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] scst_target_iqn_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_down_time = 720 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] shell_completion = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] snapshot_name_template = snapshot-%s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] split_loggers = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] state_path = /opt/stack/data/cinder {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] storage_availability_zone = nova {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] storage_protocol = iSCSI {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] syslog_log_facility = LOG_USER {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_helper = lioadm {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_ip_address = 192.168.122.128 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_port = 3260 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_protocol = iscsi {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] target_secondary_ip_addresses = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] trace_flags = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] transport_url = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] until_refresh = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_chap_auth = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_default_quota_class = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_journal = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_json = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_multipath_for_image_xfer = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_stderr = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] use_syslog = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] verify_glance_signatures = enabled {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_api_class = cinder.volume.api.API {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_backend_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_clear = zero {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_clear_ionice = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_clear_size = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_copy_bps_limit = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_dd_blocksize = 1M {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_name_template = volume-%s {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_service_inithost_offload = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volume_usage_audit_period = month {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] zoning_mode = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_concurrency.disable_process_locking = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.auth_section = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.auth_type = password {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.auth_version = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.cache = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.include_service_catalog = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.interface = public {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_password = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcache_username = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.region_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.service_type = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.backend = dogpile.cache.null {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.backend_argument = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.backend_expiration_time = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.config_prefix = cache.oslo {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.debug_cache_backend = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.enable_retry_client = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87600) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 20:14:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 20:14:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Running cmd (subprocess): mount.quobyte {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.enable_socket_keepalive = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.expiration_time = 600 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.hashclient_retry_attempts = 2 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_dead_retry = 300 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_pool_maxsize = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_sasl_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.proxies = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.redis_db = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.redis_server = localhost:6379 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.retry_attempts = 2 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.retry_delay = 0.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.socket_keepalive_count = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.socket_keepalive_idle = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.socket_keepalive_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.socket_timeout = 1.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.tls_allowed_ciphers = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.tls_cafile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.tls_certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.tls_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.tls_keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cache.username = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] coordination.backend_url = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.asyncio_connection = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.asyncio_slave_connection = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.backend = sqlalchemy {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.connection = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.connection_debug = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.connection_parameters = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.connection_recycle_time = 3600 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.connection_trace = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.db_inc_retry_interval = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.db_max_retries = 20 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.db_max_retry_interval = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.db_retry_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.max_overflow = 50 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.max_pool_size = 5 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.max_retries = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.mysql_wsrep_sync_wait = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.pool_timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.retry_interval = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.slave_connection = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.sqlite_synchronous = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.synchronous_reader = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] database.use_db_reconnect = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.connection_string = messaging:// {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.es_doc_type = notification {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.es_scroll_size = 10000 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.es_scroll_time = 2m {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.filter_error_trace = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.hmac_keys = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.sentinel_service_name = mymaster {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.socket_timeout = 0.1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.trace_requests = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler.trace_sqlalchemy = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler_jaeger.process_tags = {} {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler_jaeger.service_name_prefix = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] profiler_otlp.service_name_prefix = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.enforce_new_defaults = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.enforce_scope = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.policy_default_rule = default {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.policy_file = policy.yaml {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.group = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.helper_command = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] privsep_osbrick.user = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.group = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.helper_command = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] cinder_sys_admin.user = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.auth_section = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.auth_type = password {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.cafile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack quobyte-client[87601]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.collect_timing = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack quobyte-client[87601]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.send_service_user_token = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.split_loggers = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] service_user.timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.auth_section = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.auth_type = password {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.collect_timing = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.region_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.split_loggers = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] glance.timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.backend_availability_zone = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.chap_password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.chap_username = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.disk_geometry = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_client_cert = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_client_cert_key = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_data_namespace = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.driver_use_ssl = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.extra_capabilities = {} {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.filter_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.goodness_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iscsi_target_flags = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iscsi_write_cache = on {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iser_helper = tgtadm {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iser_port = 3260 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_host = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_login = admin {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_mount_options = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_private_key = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_share_path = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.num_shell_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.quobyte_volume_url = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.replication_device = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.report_discard_supported = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.reserved_percentage = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_helper = tgtadm {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_port = 3260 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_protocol = iscsi {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.trace_flags = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.unique_fqdn_network = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.use_chap_auth = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_backend_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_clear = zero {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_clear_ionice = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_clear_size = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_reports.file_event_handler = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_reports.log_dir = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.backend_availability_zone = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.backend_host = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.chap_password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.chap_username = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.chiscsi_conf = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.disk_geometry = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_client_cert = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_data_namespace = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.driver_use_ssl = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.extra_capabilities = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.filter_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.goodness_function = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iser_helper = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iser_ip_address = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iser_port = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.iser_target_prefix = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_host = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_login = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_mount_options = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_password = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_private_key = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_share_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_ssh_port = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.num_shell_tries = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.nvmet_port_id = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.replication_device = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.report_discard_supported = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.reserved_percentage = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.scst_target_driver = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:53 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.storage_protocol = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_helper = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_ip_address = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_port = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_prefix = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_protocol = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.trace_flags = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.use_chap_auth = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_clear = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_clear_size = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] QuobyteHD.volumes_dir = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_notifications.driver = [] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_notifications.retry = -1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] key_manager.fixed_key = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.barbican_api_version = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.barbican_endpoint = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.barbican_endpoint_type = public {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.barbican_region_name = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.cafile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.collect_timing = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.number_of_retries = 60 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.retry_delay = 1 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.send_service_user_token = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.split_loggers = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.verify_ssl = True {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican.verify_ssl_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.auth_section = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.auth_type = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.cafile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.certfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.collect_timing = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.insecure = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.keyfile = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.split_loggers = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] barbican_service_user.timeout = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.approle_role_id = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.approle_secret_id = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.auth_method = approle {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.auth_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.kv_mountpoint = secret {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.kv_path = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.kv_version = 2 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.namespace = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.root_token_id = **** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.ssl_ca_crt_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.timeout = 60.0 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.token_file = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.token_role = None {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.use_ssl = False {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 20:14:53 devstack cinder-volume[87309]: DEBUG oslo_service.backend._eventlet.service [None req-5cf528c3-802a-41fd-93cc-d08af8652513 None None] ******************************************************************************** {{(pid=87309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 20:14:53 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.volume.driver [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Driver hasn't implemented _init_vendor_properties() Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.driver [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87600) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_db.sqlalchemy.engines [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writer thread running {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.db.api [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Building query based on filter {{(pid=87600) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87600) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.keymgr.migration [None req-f69b4c3d-55fa-4002-8211-13d2c6939fb3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 20:14:53 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:53 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:53 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Driver initialization completed successfully. Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Initiating service 3 cleanup Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Service 3 cleanup completed. Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.service [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Creating RPC server for service cinder-volume {{(pid=87600) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.service [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87600) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 20:14:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:14:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:14:54 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:14:54 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:14:54 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Jul 14 20:14:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.229s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:14:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-563efa00-7499-4429-a9ae-dcffad7746db None None] Driver post RPC initialization completed successfully. Jul 14 20:15:02 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:15:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:15:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 6 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:15:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:15:03 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:15:04 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:03 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:16:03 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:03 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.556s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 6 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:16:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Flow 'volume_create_manager' (7f168d27-c99b-4cc3-b9e4-28cf930e389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a2601-3b75-48c2-978e-be3bdb719188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a2601-3b75-48c2-978e-be3bdb719188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-304541359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15cd048-df71-4b2e-9198-572b466d0aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0272a1a2a43f6b47e8c3f14df4895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:15Z,use_quota=True,user_id='855595c3dad04f5ba8d385be2e4636f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187afae9-48e0-4654-876f-9711dc3bbdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187afae9-48e0-4654-876f-9711dc3bbdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c400a3a9-b75a-46d2-a1e4-54585403349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c400a3a9-b75a-46d2-a1e4-54585403349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15cd048-df71-4b2e-9198-572b466d0aeb', 'volume_name': 'volume-d15cd048-df71-4b2e-9198-572b466d0aeb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7fea1c-6ecb-4d28-8fb6-2d3f8c06b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7fea1c-6ecb-4d28-8fb6-2d3f8c06b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c31a62-0b1f-4a75-ab6a-55cc54ab4dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Volume d15cd048-df71-4b2e-9198-572b466d0aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15cd048-df71-4b2e-9198-572b466d0aeb', 'volume_size': 1} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-304541359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15cd048-df71-4b2e-9198-572b466d0aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0272a1a2a43f6b47e8c3f14df4895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:15Z,use_quota=True,user_id='855595c3dad04f5ba8d385be2e4636f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Creating volume d15cd048-df71-4b2e-9198-572b466d0aeb {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:16:15 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:16:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:15 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb 1073741824 Jul 14 20:16:15 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:17 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb 1073741824" returned: 0 in 1.221s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:17 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb Jul 14 20:16:17 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:17 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb" returned: 0 in 0.476s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c31a62-0b1f-4a75-ab6a-55cc54ab4dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15cd048-df71-4b2e-9198-572b466d0aeb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f2ff47-c803-4466-a8e2-9ebf1f471fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:17 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Volume volume-d15cd048-df71-4b2e-9198-572b466d0aeb (d15cd048-df71-4b2e-9198-572b466d0aeb): created successfully Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f2ff47-c803-4466-a8e2-9ebf1f471fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Flow 'volume_create_manager' (7f168d27-c99b-4cc3-b9e4-28cf930e389f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cbfa3561-6a47-4ba5-bbbc-72c3ee27f085 tempest-VolumesAdminNegativeTest-1757251882 None] Created volume successfully. Jul 14 20:16:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Acquiring lock "cinder-d15cd048-df71-4b2e-9198-572b466d0aeb-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:16:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "cinder-d15cd048-df71-4b2e-9198-572b466d0aeb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:16:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Acquiring lock "cinder-quobyte-d15cd048-df71-4b2e-9198-572b466d0aeb" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:16:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "cinder-quobyte-d15cd048-df71-4b2e-9198-572b466d0aeb" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:16:18 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpts_8a5h4/privsep.sock'] Jul 14 20:16:18 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpts_8a5h4/privsep.sock Jul 14 20:16:18 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 20:16:20 devstack cinder-volume[87600]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 14 20:16:20 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:20 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Spawned new privsep daemon via rootwrap Jul 14 20:16:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Accepted privsep connection to /tmp/tmpts_8a5h4/privsep.sock {{(pid=87600) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 14 20:16:20 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 14 20:16:20 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 14 20:16:20 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 14 20:16:20 devstack cinder-volume[87600]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88564 Jul 14 20:16:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e53859-242b-43bb-b521-aa4c762a2388]: (2,) {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:16:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b96d8-6973-40ed-8aa9-5fdb4cdd019c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:16:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:20 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb Jul 14 20:16:20 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:21 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb" returned: 0 in 0.561s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:21 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb Jul 14 20:16:21 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:21 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d15cd048-df71-4b2e-9198-572b466d0aeb" returned: 0 in 0.341s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "cinder-quobyte-d15cd048-df71-4b2e-9198-572b466d0aeb" released by "delete_volume" :: held 3.010s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:16:21 devstack cinder-volume[87600]: WARNING cinder.quota [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:16:21 devstack cinder-volume[87600]: WARNING cinder.quota [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Created reservations ['06876aa2-f5ea-4231-8470-d615822f72b2', '4350b37d-0b62-420b-bade-a17eaba6a3a3', 'c5dca4bc-1212-40c9-a868-c8a70f00431e', '2572f883-1ab8-46b3-bb2a-13e80db71656'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:21 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:16:21 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:22 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:22 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:16:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Deleted volume successfully. Jul 14 20:16:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-31771e95-1fcd-4fff-a243-798f3fcdbd9a tempest-VolumesAdminNegativeTest-1757251882 None] Lock "cinder-d15cd048-df71-4b2e-9198-572b466d0aeb-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Flow 'volume_create_manager' (622ac3b3-9d14-4975-b6bc-ade126c1b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b5d5a-f9d7-4d67-af53-91cbe04cb3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b5d5a-f9d7-4d67-af53-91cbe04cb3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1922055032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268dc130-18e9-4a23-bc0a-77cee78d088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3372d70ed464c34a9a9a146b7e10026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:32Z,use_quota=True,user_id='94b486c08cac44be8eabb7906b3edc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfcccd5-53b3-4263-b9d6-f9569eddda03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfcccd5-53b3-4263-b9d6-f9569eddda03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f466644d-b387-49a3-a3bc-2b2711224ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f466644d-b387-49a3-a3bc-2b2711224ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268dc130-18e9-4a23-bc0a-77cee78d088b', 'volume_name': 'volume-268dc130-18e9-4a23-bc0a-77cee78d088b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad607b99-e056-4a6d-b355-295ef611d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad607b99-e056-4a6d-b355-295ef611d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7c8960-5642-44d7-87d4-c3d270ed031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:31 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Volume 268dc130-18e9-4a23-bc0a-77cee78d088b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268dc130-18e9-4a23-bc0a-77cee78d088b', 'volume_size': 1} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1922055032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268dc130-18e9-4a23-bc0a-77cee78d088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3372d70ed464c34a9a9a146b7e10026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:32Z,use_quota=True,user_id='94b486c08cac44be8eabb7906b3edc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Creating volume 268dc130-18e9-4a23-bc0a-77cee78d088b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:16:31 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:16:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:32 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b 1073741824 Jul 14 20:16:32 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:32 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b 1073741824" returned: 0 in 0.614s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:32 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b Jul 14 20:16:32 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:32 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7c8960-5642-44d7-87d4-c3d270ed031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268dc130-18e9-4a23-bc0a-77cee78d088b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06a04e-bb9b-45aa-9a9d-8664e4ce3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Volume volume-268dc130-18e9-4a23-bc0a-77cee78d088b (268dc130-18e9-4a23-bc0a-77cee78d088b): created successfully Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06a04e-bb9b-45aa-9a9d-8664e4ce3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Flow 'volume_create_manager' (622ac3b3-9d14-4975-b6bc-ade126c1b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-848fa537-2cb9-4277-8352-8ac0b3fcbd77 tempest-AttachVolumeShelveTestJSON-685890043 None] Created volume successfully. Jul 14 20:16:42 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:16:42 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:16:46 devstack cinder-volume[87600]: WARNING py.warnings [req-8905142f-83e7-44a5-b8ed-5a8d73f0b2e5 req-95d44339-15ca-422e-b840-ebc15fb5b74e tempest-AttachVolumeShelveTestJSON-685890043 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 14 20:16:46 devstack cinder-volume[87600]: .first() Jul 14 20:16:46 devstack cinder-volume[87600]: Jul 14 20:16:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-8905142f-83e7-44a5-b8ed-5a8d73f0b2e5 req-95d44339-15ca-422e-b840-ebc15fb5b74e tempest-AttachVolumeShelveTestJSON-685890043 None] No connector for attachment bc48b845-a7ac-4f81-a4f1-6a447b2cb80f; skipping storage backend terminate_connection call. {{(pid=87600) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 14 20:16:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-8905142f-83e7-44a5-b8ed-5a8d73f0b2e5 req-95d44339-15ca-422e-b840-ebc15fb5b74e tempest-AttachVolumeShelveTestJSON-685890043 None] Deleting attachment bc48b845-a7ac-4f81-a4f1-6a447b2cb80f. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Flow 'volume_create_manager' (e475bf7f-9d12-4730-9540-37b2f96226f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dd9c0c-985e-4014-b089-a33819212d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46dd9c0c-985e-4014-b089-a33819212d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1057608017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79aa8fd-4e1b-47bf-a630-120c74a7de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fcc787143064747b7a04af84652899b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:49Z,use_quota=True,user_id='71b3c7fe0f114428b5a1a513c3948874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24285e62-5339-4eae-9895-bbc2338ef48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24285e62-5339-4eae-9895-bbc2338ef48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01aa237a-dd40-4d1f-af72-bb89a6738106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01aa237a-dd40-4d1f-af72-bb89a6738106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'volume_name': 'volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df74ace6-a8aa-472a-a9a0-720cba9b38c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df74ace6-a8aa-472a-a9a0-720cba9b38c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa175d-bebd-46ca-b80c-c11a306103e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Volume f79aa8fd-4e1b-47bf-a630-120c74a7de54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'volume_size': 1} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1057608017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79aa8fd-4e1b-47bf-a630-120c74a7de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fcc787143064747b7a04af84652899b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:49Z,use_quota=True,user_id='71b3c7fe0f114428b5a1a513c3948874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Creating volume f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:16:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:49 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 1073741824 Jul 14 20:16:49 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:49 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 1073741824" returned: 0 in 0.756s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:49 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 Jul 14 20:16:49 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:50 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54" returned: 0 in 0.574s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa175d-bebd-46ca-b80c-c11a306103e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f7414-3a5e-4013-825f-0c32fecbad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Volume volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 (f79aa8fd-4e1b-47bf-a630-120c74a7de54): created successfully Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f7414-3a5e-4013-825f-0c32fecbad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Flow 'volume_create_manager' (e475bf7f-9d12-4730-9540-37b2f96226f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9b54aef7-68ec-4f03-b026-77c086970341 tempest-ServerActionsTestOtherA-518346874 None] Created volume successfully. Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Flow 'volume_create_manager' (897fc0da-8764-41e9-a74d-2a414dca3e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41616210-bfd8-4051-8f30-2f4ab93aff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41616210-bfd8-4051-8f30-2f4ab93aff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-321633380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b00919-df66-4484-8b8e-23dca2f116ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff1c637b5a6470c9ea060bb9d9a36aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:57Z,use_quota=True,user_id='0c5d60894fce4dea99b410a44443fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7e83d6-7978-440b-8f98-61c1e5fb1d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7e83d6-7978-440b-8f98-61c1e5fb1d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59550876-567c-4160-91c3-b5a4c3642f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59550876-567c-4160-91c3-b5a4c3642f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b00919-df66-4484-8b8e-23dca2f116ab', 'volume_name': 'volume-01b00919-df66-4484-8b8e-23dca2f116ab', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590e7a3e-b7d9-4f3e-ae57-b060f52b6e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590e7a3e-b7d9-4f3e-ae57-b060f52b6e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8d8fa5-c557-4518-92f4-baabef17f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:57 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Volume 01b00919-df66-4484-8b8e-23dca2f116ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b00919-df66-4484-8b8e-23dca2f116ab', 'volume_size': 1} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-321633380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b00919-df66-4484-8b8e-23dca2f116ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff1c637b5a6470c9ea060bb9d9a36aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:16:57Z,use_quota=True,user_id='0c5d60894fce4dea99b410a44443fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Creating volume 01b00919-df66-4484-8b8e-23dca2f116ab {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:16:57 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:16:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:57 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab 1073741824 Jul 14 20:16:57 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:58 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab 1073741824" returned: 0 in 0.632s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:16:58 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab Jul 14 20:16:58 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:16:58 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab" returned: 0 in 0.537s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8d8fa5-c557-4518-92f4-baabef17f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b00919-df66-4484-8b8e-23dca2f116ab', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce5a97-787d-4f7a-bd0e-3372054340cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:16:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Volume volume-01b00919-df66-4484-8b8e-23dca2f116ab (01b00919-df66-4484-8b8e-23dca2f116ab): created successfully Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce5a97-787d-4f7a-bd0e-3372054340cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:16:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Flow 'volume_create_manager' (897fc0da-8764-41e9-a74d-2a414dca3e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:16:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b2aea7db-a008-41b3-b9a8-dd214a6e1f91 tempest-DeleteServersTestJSON-1455020277 None] Created volume successfully. Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:03 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:17:03 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:03 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.563s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e18ffab-3ed2-4bbe-89aa-d16fecff91c3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:04 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab Jul 14 20:17:04 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:04 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab" returned: 0 in 0.546s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.578s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-01b00919-df66-4484-8b8e-23dca2f116ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b4fbc1b-e5b8-4f9b-9638-ca90df3fde2d', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:17:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-3f6141f5-d9ba-4ef5-b2e8-e40a179e37d4 req-fe13e052-c49f-4037-addf-1e5c0ac9ff39 tempest-DeleteServersTestJSON-1455020277 None] attachment_update completed successfully. Jul 14 20:17:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-243c8ebf-1bfc-4a4c-a6b3-a082da6f4501 req-08efbc90-cafe-43e0-af66-80bdf4efa5a3 tempest-DeleteServersTestJSON-1455020277 None] Terminate volume connection completed successfully. Jul 14 20:17:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-243c8ebf-1bfc-4a4c-a6b3-a082da6f4501 req-08efbc90-cafe-43e0-af66-80bdf4efa5a3 tempest-DeleteServersTestJSON-1455020277 None] Deleting attachment 5b4fbc1b-e5b8-4f9b-9638-ca90df3fde2d. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:17:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "cinder-01b00919-df66-4484-8b8e-23dca2f116ab-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:17:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "cinder-01b00919-df66-4484-8b8e-23dca2f116ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "cinder-quobyte-01b00919-df66-4484-8b8e-23dca2f116ab" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "cinder-quobyte-01b00919-df66-4484-8b8e-23dca2f116ab" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a5649-7f30-415c-9e76-6984181a3933]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:12 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab Jul 14 20:17:12 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:12 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab" returned: 0 in 0.376s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:12 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab Jul 14 20:17:12 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:12 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-01b00919-df66-4484-8b8e-23dca2f116ab" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "cinder-quobyte-01b00919-df66-4484-8b8e-23dca2f116ab" released by "delete_volume" :: held 0.734s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Created reservations ['3c065878-fcdf-4a9f-a5e3-670633e849ba', '3a51fd8d-c8e0-4072-b72a-1339e5e6741d', '0ce23bdb-1815-4374-97cc-6f5fa2056f51', '5ea9f47e-bcf1-4aaf-a4bd-c5eafe5ce3f7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:12 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:17:12 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:13 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.439s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:13 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:17:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Deleted volume successfully. Jul 14 20:17:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f473474d-4ed1-48bd-bb19-c0aad8f53f78 tempest-DeleteServersTestJSON-1455020277 None] Lock "cinder-01b00919-df66-4484-8b8e-23dca2f116ab-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Flow 'volume_create_manager' (7b2ac9fd-0d9a-4ecb-8698-13bbdd450d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475b523-2a9a-420c-822f-af51b261ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475b523-2a9a-420c-822f-af51b261ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1809037050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b06d339-c47d-4b91-8e3d-d1ff76c88a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721cdb5f3344ba9805707ce3e41c5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:17:23Z,use_quota=True,user_id='3ad9fdb93ebf4d66a83d0e7952c6e2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce39fc-6332-4bc2-b0ba-1ca093140d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce39fc-6332-4bc2-b0ba-1ca093140d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50035b4b-6514-4b01-9d37-45d005e47cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50035b4b-6514-4b01-9d37-45d005e47cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b06d339-c47d-4b91-8e3d-d1ff76c88a0b', 'volume_name': 'volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f409f05-b19a-4619-ae67-14a3732526fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f409f05-b19a-4619-ae67-14a3732526fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bf63ea-8456-4f83-89ae-822454ec56c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Volume 1b06d339-c47d-4b91-8e3d-d1ff76c88a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b', 'volume_size': 1} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1809037050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b06d339-c47d-4b91-8e3d-d1ff76c88a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b721cdb5f3344ba9805707ce3e41c5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:17:23Z,use_quota=True,user_id='3ad9fdb93ebf4d66a83d0e7952c6e2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Creating volume 1b06d339-c47d-4b91-8e3d-d1ff76c88a0b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:17:22 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:17:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:23 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b 1073741824 Jul 14 20:17:23 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:23 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b 1073741824" returned: 0 in 0.709s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:23 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b Jul 14 20:17:23 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:24 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" returned: 0 in 0.314s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bf63ea-8456-4f83-89ae-822454ec56c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eb2fca-507e-4248-a32a-3b7857140484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Volume volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b (1b06d339-c47d-4b91-8e3d-d1ff76c88a0b): created successfully Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eb2fca-507e-4248-a32a-3b7857140484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Flow 'volume_create_manager' (7b2ac9fd-0d9a-4ecb-8698-13bbdd450d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:17:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-018899e9-6bfc-4e23-8b9d-4180b21dabb6 tempest-TaggedAttachmentsTest-156084645 None] Created volume successfully. Jul 14 20:17:34 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:17:34 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=14,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Acquiring lock "cinder-268dc130-18e9-4a23-bc0a-77cee78d088b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "cinder-268dc130-18e9-4a23-bc0a-77cee78d088b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Acquiring lock "cinder-quobyte-268dc130-18e9-4a23-bc0a-77cee78d088b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "cinder-quobyte-268dc130-18e9-4a23-bc0a-77cee78d088b" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[62002997-d7d0-49bb-8aed-0ef7bd1338b0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:17:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:40 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b Jul 14 20:17:40 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:41 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b" returned: 0 in 0.604s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:41 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b Jul 14 20:17:41 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:41 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-268dc130-18e9-4a23-bc0a-77cee78d088b" returned: 0 in 0.299s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "cinder-quobyte-268dc130-18e9-4a23-bc0a-77cee78d088b" released by "delete_volume" :: held 0.958s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Created reservations ['89d93998-cd5d-43f8-9cee-f5b0eeebbc3c', '3e57bf03-b726-4e73-90fb-8be5fcbb4d21', '52887f3c-868f-4de9-a0ce-e86de203a9c8', 'fbfc3359-4f2a-4ffd-9b53-1631c12ac96a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:41 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:17:41 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:42 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:42 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:17:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Deleted volume successfully. Jul 14 20:17:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7dbd9cb-d9dd-4dee-8580-5834a747f8eb tempest-AttachVolumeShelveTestJSON-685890043 None] Lock "cinder-268dc130-18e9-4a23-bc0a-77cee78d088b-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:17:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdc2ba-a7f7-4746-bf5c-b0df3cc7a08a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:17:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:44 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 Jul 14 20:17:44 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:44 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54" returned: 0 in 0.555s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.578s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b44db44-2515-447c-95a9-50b455acd673', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:17:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-9d80d040-68ff-4790-a0ee-5d271d18d50c req-9644f2fc-65ef-4029-bff3-b525ef973699 tempest-ServerActionsTestOtherA-518346874 None] attachment_update completed successfully. Jul 14 20:17:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-652df936-d2dc-4e68-84f9-93d0882b9cba tempest-ServerActionsTestOtherA-518346874 None] Terminate volume connection completed successfully. Jul 14 20:17:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-652df936-d2dc-4e68-84f9-93d0882b9cba tempest-ServerActionsTestOtherA-518346874 None] Deleting attachment 2b44db44-2515-447c-95a9-50b455acd673. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:17:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:53 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6a58d0-bc0a-4141-a1d3-a40486dbf378]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:17:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:53 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 Jul 14 20:17:53 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:17:54 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Jul 14 20:17:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54" returned: 0 in 0.942s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:17:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b98c9bc9-c717-4a52-9533-4dca6cfcb8e5', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:17:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-b4bcb872-796b-4cb7-9df5-6432a4cc01f8 req-be750f2e-a3c8-4570-93b2-ea86ed6c5f8c tempest-ServerActionsTestOtherA-518346874 None] attachment_update completed successfully. Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (77578aeb-d5d8-42f9-9e31-e3aff81a9a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428fdee5-920d-4b81-9b77-bf1cbe95bc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428fdee5-920d-4b81-9b77-bf1cbe95bc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1503289847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ace3a18-fee7-421c-b277-13bc21cc5e97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:17:59Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63ee9d2-106c-4b63-b38c-aa3810d50297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63ee9d2-106c-4b63-b38c-aa3810d50297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e052ed5e-6c2e-42b3-b1f1-475ed2dda634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e052ed5e-6c2e-42b3-b1f1-475ed2dda634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ace3a18-fee7-421c-b277-13bc21cc5e97', 'volume_name': 'volume-7ace3a18-fee7-421c-b277-13bc21cc5e97', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0946fdc-47f0-4518-8a7c-055a3f070bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0946fdc-47f0-4518-8a7c-055a3f070bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6d4938-322b-4acc-a4d5-62d656992b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:17:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Volume 7ace3a18-fee7-421c-b277-13bc21cc5e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ace3a18-fee7-421c-b277-13bc21cc5e97', 'volume_size': 1} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1503289847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ace3a18-fee7-421c-b277-13bc21cc5e97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:17:59Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Creating volume 7ace3a18-fee7-421c-b277-13bc21cc5e97 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:17:59 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:17:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:17:59 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 1073741824 Jul 14 20:17:59 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:01 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 1073741824" returned: 0 in 1.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:01 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 Jul 14 20:18:01 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:01 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97" returned: 0 in 0.623s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6d4938-322b-4acc-a4d5-62d656992b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ace3a18-fee7-421c-b277-13bc21cc5e97', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a81c4a9-465f-4416-849c-37146f8a36a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Volume volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 (7ace3a18-fee7-421c-b277-13bc21cc5e97): created successfully Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a81c4a9-465f-4416-849c-37146f8a36a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (77578aeb-d5d8-42f9-9e31-e3aff81a9a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-54d0624e-a3df-4ec8-ac09-3a95757bea62 tempest-VolumesTestJSON-1380223962 None] Created volume successfully. Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:03 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:03 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:04 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 1.103s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:04 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:04 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:18:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 8 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:18:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (3fcfd41f-316b-436c-9428-7314f3bcec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f85912-12bf-4684-96e5-02f69a54f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f85912-12bf-4684-96e5-02f69a54f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235158511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311a768-6526-4c84-bb93-7ce1c2eff662,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:05Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa84be23-4d8e-4116-a164-41302b7a75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa84be23-4d8e-4116-a164-41302b7a75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7352c2a4-087d-4c1a-821f-6e452ae0bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7352c2a4-087d-4c1a-821f-6e452ae0bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5311a768-6526-4c84-bb93-7ce1c2eff662', 'volume_name': 'volume-5311a768-6526-4c84-bb93-7ce1c2eff662', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0246652-02dc-4168-97f2-0906d42abd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0246652-02dc-4168-97f2-0906d42abd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a686fc-eb67-45c1-bdff-d627cad07bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Volume 5311a768-6526-4c84-bb93-7ce1c2eff662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5311a768-6526-4c84-bb93-7ce1c2eff662', 'volume_size': 1} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235158511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311a768-6526-4c84-bb93-7ce1c2eff662,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:05Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Creating volume 5311a768-6526-4c84-bb93-7ce1c2eff662 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:18:05 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:18:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:06 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 1073741824 Jul 14 20:18:06 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:06 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 1073741824" returned: 0 in 0.995s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:07 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 Jul 14 20:18:07 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:07 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662" returned: 0 in 0.326s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a686fc-eb67-45c1-bdff-d627cad07bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5311a768-6526-4c84-bb93-7ce1c2eff662', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dd9b0e-832d-4b36-abde-090d2fd95d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Volume volume-5311a768-6526-4c84-bb93-7ce1c2eff662 (5311a768-6526-4c84-bb93-7ce1c2eff662): created successfully Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dd9b0e-832d-4b36-abde-090d2fd95d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (3fcfd41f-316b-436c-9428-7314f3bcec41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3256774f-d76e-4f41-b716-23013f647600 tempest-VolumesTestJSON-1380223962 None] Created volume successfully. Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Flow 'volume_create_manager' (0f7e0979-7170-4f85-9863-f5689f3903dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c203d3f4-2468-423a-98b9-fa033e4e50f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c203d3f4-2468-423a-98b9-fa033e4e50f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1961598330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47663da3-439a-4ba8-a10e-c2215f3d8456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f70fae1bad43ba91fc4e2478c0c725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:09Z,use_quota=True,user_id='574b7ce39ac14914ad0769109384e95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b9179-63ca-4fa2-ae25-a8fb63f97f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b9179-63ca-4fa2-ae25-a8fb63f97f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb53d92-5ca3-4da4-ba67-5111b106b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb53d92-5ca3-4da4-ba67-5111b106b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47663da3-439a-4ba8-a10e-c2215f3d8456', 'volume_name': 'volume-47663da3-439a-4ba8-a10e-c2215f3d8456', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235d51b3-9cf0-454c-9d30-431ab3cd21bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235d51b3-9cf0-454c-9d30-431ab3cd21bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0209cf66-9378-4caa-bb8c-0fc365deabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:09 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Volume 47663da3-439a-4ba8-a10e-c2215f3d8456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47663da3-439a-4ba8-a10e-c2215f3d8456', 'volume_size': 1} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1961598330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47663da3-439a-4ba8-a10e-c2215f3d8456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f70fae1bad43ba91fc4e2478c0c725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:09Z,use_quota=True,user_id='574b7ce39ac14914ad0769109384e95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Creating volume 47663da3-439a-4ba8-a10e-c2215f3d8456 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:18:09 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:18:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:09 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 1073741824 Jul 14 20:18:09 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (8187203d-d3f4-40a2-aef7-b7f98de5490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a616c33e-5ccb-48da-b706-84899dd8f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a616c33e-5ccb-48da-b706-84899dd8f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-771320549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d13d4c-6d43-4fa7-ae36-35e416369e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:11Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73084bbe-f119-4d1b-8ae7-00578a4e5b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73084bbe-f119-4d1b-8ae7-00578a4e5b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695526e2-43f1-47a1-85fd-d9ddfe64f8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695526e2-43f1-47a1-85fd-d9ddfe64f8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d13d4c-6d43-4fa7-ae36-35e416369e0c', 'volume_name': 'volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:10 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60379782-8fb7-49b3-9a60-59d01a2c93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60379782-8fb7-49b3-9a60-59d01a2c93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0e5d54-9282-4a69-94b8-fbed4dbc759c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:10 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Volume 50d13d4c-6d43-4fa7-ae36-35e416369e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c', 'volume_size': 1} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 1073741824" returned: 0 in 1.073s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:11 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 Jul 14 20:18:11 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:11 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456" returned: 0 in 0.763s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-771320549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d13d4c-6d43-4fa7-ae36-35e416369e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05aefcf29fa8477aaee358d01ad90300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:18:11Z,use_quota=True,user_id='d44467f6af7c4f8bae659117d123ea4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Creating volume 50d13d4c-6d43-4fa7-ae36-35e416369e0c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:18:11 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0209cf66-9378-4caa-bb8c-0fc365deabb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47663da3-439a-4ba8-a10e-c2215f3d8456', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:11 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c 1073741824 Jul 14 20:18:11 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d03fcf-dfc6-46ec-aeca-c1905c6db10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:11 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Volume volume-47663da3-439a-4ba8-a10e-c2215f3d8456 (47663da3-439a-4ba8-a10e-c2215f3d8456): created successfully Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d03fcf-dfc6-46ec-aeca-c1905c6db10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Flow 'volume_create_manager' (0f7e0979-7170-4f85-9863-f5689f3903dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6496f928-627f-4fbd-a854-019496606451 tempest-ServerRescueNegativeTestJSON-427491620 None] Created volume successfully. Jul 14 20:18:13 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c 1073741824" returned: 0 in 1.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:13 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c Jul 14 20:18:13 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:14 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c" returned: 0 in 0.638s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0e5d54-9282-4a69-94b8-fbed4dbc759c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a5b229-521e-4829-90c6-416c73687c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:18:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Volume volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c (50d13d4c-6d43-4fa7-ae36-35e416369e0c): created successfully Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a5b229-521e-4829-90c6-416c73687c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Flow 'volume_create_manager' (8187203d-d3f4-40a2-aef7-b7f98de5490c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:18:14 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-06945cd7-c377-44f2-9e09-8a99b77788fc tempest-VolumesTestJSON-1380223962 None] Created volume successfully. Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[79609ee7-0da7-4d39-a5e0-9954cbf86bd1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:15 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b Jul 14 20:18:15 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:16 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" returned: 0 in 1.286s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.330s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b4b86ba-f8b6-4563-af2a-5f8a349e7dcd', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:18:16 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-cfb0477d-5be9-40bf-b859-09ebd350e28f req-ff838300-b852-49c3-b64a-205f356b0785 tempest-TaggedAttachmentsTest-156084645 None] attachment_update completed successfully. Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-50d13d4c-6d43-4fa7-ae36-35e416369e0c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "cinder-50d13d4c-6d43-4fa7-ae36-35e416369e0c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-quobyte-50d13d4c-6d43-4fa7-ae36-35e416369e0c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-50d13d4c-6d43-4fa7-ae36-35e416369e0c" acquired by "delete_volume" :: waited 0.145s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cce971a-7ead-4470-9f54-eb99506cfea1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:18 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c Jul 14 20:18:18 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:18 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c" returned: 0 in 0.911s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:18 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c Jul 14 20:18:18 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:19 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50d13d4c-6d43-4fa7-ae36-35e416369e0c" returned: 0 in 0.469s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-50d13d4c-6d43-4fa7-ae36-35e416369e0c" released by "delete_volume" :: held 1.500s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Created reservations ['f155228c-71fc-44d4-a357-f5168d06c458', '1ccb4432-05fe-4a04-a845-052c2ecb35e0', '07c66668-77a8-4aff-bd50-6293a7a0191b', '0c909d03-b497-4222-ada9-6c80e8e3aa40'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:19 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:19 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-5311a768-6526-4c84-bb93-7ce1c2eff662-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "cinder-5311a768-6526-4c84-bb93-7ce1c2eff662-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-quobyte-5311a768-6526-4c84-bb93-7ce1c2eff662" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:20 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.683s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Deleted volume successfully. Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-5311a768-6526-4c84-bb93-7ce1c2eff662" acquired by "delete_volume" :: waited 0.105s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb2b8e-4c90-4f46-ad76-77c4fbf5fd32]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4ec4d98a-9ba3-4cdb-b4b3-54cf1f52d8af tempest-VolumesTestJSON-1380223962 None] Lock "cinder-50d13d4c-6d43-4fa7-ae36-35e416369e0c-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:20 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 Jul 14 20:18:20 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:20 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662" returned: 0 in 0.506s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:20 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662 Jul 14 20:18:20 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:21 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5311a768-6526-4c84-bb93-7ce1c2eff662" returned: 0 in 0.747s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-5311a768-6526-4c84-bb93-7ce1c2eff662" released by "delete_volume" :: held 1.368s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Created reservations ['f6a6e429-4121-4d95-a8ce-27c3c2762cfa', 'e06fd4f4-4581-419b-a14c-301fcffff17c', '9176b737-7e17-4b82-a08a-633a01bb1a55', '30d4dc23-543d-4707-8f68-cb9ca3123494'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:21 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:21 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-a800977f-dbb6-4606-9dab-95b145b1d14f req-870d4773-5371-426b-8cfe-641bd0a1bb19 tempest-TaggedAttachmentsTest-156084645 None] Terminate volume connection completed successfully. Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-a800977f-dbb6-4606-9dab-95b145b1d14f req-870d4773-5371-426b-8cfe-641bd0a1bb19 tempest-TaggedAttachmentsTest-156084645 None] Deleting attachment 0b4b86ba-f8b6-4563-af2a-5f8a349e7dcd. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:18:22 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.610s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Deleted volume successfully. Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-7ace3a18-fee7-421c-b277-13bc21cc5e97-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-da004cf8-4304-485a-884d-bbd7bd6a0613 tempest-VolumesTestJSON-1380223962 None] Lock "cinder-5311a768-6526-4c84-bb93-7ce1c2eff662-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "cinder-7ace3a18-fee7-421c-b277-13bc21cc5e97-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Acquiring lock "cinder-quobyte-7ace3a18-fee7-421c-b277-13bc21cc5e97" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-7ace3a18-fee7-421c-b277-13bc21cc5e97" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f876ec-b9ca-4997-bd13-7e77276d0cfe]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:23 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 Jul 14 20:18:23 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:24 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97" returned: 0 in 1.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:24 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97 Jul 14 20:18:24 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:24 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7ace3a18-fee7-421c-b277-13bc21cc5e97" returned: 0 in 0.599s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "cinder-quobyte-7ace3a18-fee7-421c-b277-13bc21cc5e97" released by "delete_volume" :: held 2.103s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Created reservations ['dd083ccf-81e9-41cc-87c7-4f9a7a394a48', 'aa80ab18-98bd-4eea-8469-cc47a0f3f0e1', '17bb0585-19c7-4cd2-b1f1-cad7062093ca', '214ee770-ce46-4d61-add0-42c68f0a998d'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:25 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:25 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:26 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.877s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:26 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Deleted volume successfully. Jul 14 20:18:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1cb0aa0-c031-4135-8cde-2f96436fc81f tempest-VolumesTestJSON-1380223962 None] Lock "cinder-7ace3a18-fee7-421c-b277-13bc21cc5e97-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Acquiring lock "cinder-47663da3-439a-4ba8-a10e-c2215f3d8456-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "cinder-47663da3-439a-4ba8-a10e-c2215f3d8456-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Acquiring lock "cinder-quobyte-47663da3-439a-4ba8-a10e-c2215f3d8456" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "cinder-quobyte-47663da3-439a-4ba8-a10e-c2215f3d8456" acquired by "delete_volume" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12d738-1030-467c-a671-7f928abbe8b3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:28 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 Jul 14 20:18:28 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:28 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456" returned: 0 in 0.684s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:29 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456 Jul 14 20:18:29 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:29 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-47663da3-439a-4ba8-a10e-c2215f3d8456" returned: 0 in 0.415s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "cinder-quobyte-47663da3-439a-4ba8-a10e-c2215f3d8456" released by "delete_volume" :: held 1.196s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Created reservations ['8d3a61a2-72ef-43e3-8629-3089076df5b1', 'ef01639f-a04f-4385-96c0-0fb8ab1d9434', '13d307ae-cf06-4a9f-b921-45b053935e92', '5cbd5026-8bb9-4c53-9a12-650cfc853db0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:29 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:29 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:30 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.376s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Deleted volume successfully. Jul 14 20:18:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-278d1839-18ff-4ba2-9a9e-6ce6b25e5aab tempest-ServerRescueNegativeTestJSON-427491620 None] Lock "cinder-47663da3-439a-4ba8-a10e-c2215f3d8456-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "cinder-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "cinder-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=53,cinder:INSERT=11,cinder:UPDATE=51,cinder:DELETE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=63,cinder:SELECT=51,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "cinder-quobyte-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "cinder-quobyte-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af347db-0318-4740-b445-84d8a7e73a39]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:37 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b Jul 14 20:18:37 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:38 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" returned: 0 in 0.539s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:38 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b Jul 14 20:18:38 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:38 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "cinder-quobyte-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b" released by "delete_volume" :: held 0.888s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Created reservations ['d15113cc-48b2-4486-abd6-3be22655b174', '80647101-f0aa-436d-a6fd-3f7acf15b7dc', 'bb4d6b0d-ddef-4b9d-9d78-3c055b85366b', '4f474015-3944-40c4-aabb-785d4f15edc8'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:38 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:38 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:38 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Deleted volume successfully. Jul 14 20:18:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-77d59476-4941-4d05-a7b8-12790dbd6b61 tempest-TaggedAttachmentsTest-156084645 None] Lock "cinder-1b06d339-c47d-4b91-8e3d-d1ff76c88a0b-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-184a5938-c4c7-4262-8392-b536c5864646 req-e1741817-055d-479e-a7c4-2bfa8670bc76 tempest-ServerActionsTestOtherA-518346874 None] Terminate volume connection completed successfully. Jul 14 20:18:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-184a5938-c4c7-4262-8392-b536c5864646 req-e1741817-055d-479e-a7c4-2bfa8670bc76 tempest-ServerActionsTestOtherA-518346874 None] Deleting attachment b98c9bc9-c717-4a52-9533-4dca6cfcb8e5. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "cinder-f79aa8fd-4e1b-47bf-a630-120c74a7de54-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "cinder-f79aa8fd-4e1b-47bf-a630-120c74a7de54-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "cinder-quobyte-f79aa8fd-4e1b-47bf-a630-120c74a7de54" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "cinder-quobyte-f79aa8fd-4e1b-47bf-a630-120c74a7de54" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaeb3db-b531-4a8c-9017-15522cfa28eb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:52 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 Jul 14 20:18:52 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:52 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54" returned: 0 in 0.535s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:53 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54 Jul 14 20:18:53 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:53 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f79aa8fd-4e1b-47bf-a630-120c74a7de54" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "cinder-quobyte-f79aa8fd-4e1b-47bf-a630-120c74a7de54" released by "delete_volume" :: held 0.878s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Created reservations ['252d9bdf-f8e4-4217-8859-c8d4c2c85509', '72932acb-6e57-46ca-b5e7-c460aeb1e6c3', '4aefa03c-9623-450c-b6eb-e37db69ecec9', 'e9d61c7a-5e2a-4624-9e4f-98fc0a383114'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:18:53 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:18:53 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:18:53 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:18:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Deleted volume successfully. Jul 14 20:18:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a215e44-5bc6-4721-a5f3-14b4cb68598e tempest-ServerActionsTestOtherA-518346874 None] Lock "cinder-f79aa8fd-4e1b-47bf-a630-120c74a7de54-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Flow 'volume_create_manager' (cb6e229e-138a-4d04-9bda-b148cd103ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2299b632-60db-4e16-a80c-12d669348863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2299b632-60db-4e16-a80c-12d669348863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-464911996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4184b88-a19b-4353-b967-be49e5d30b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01555273120a4833bdadea3352bb8f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:01Z,use_quota=True,user_id='1d39f2459bc14a3cb731ab6216ead81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08715bf0-8f47-4393-bf9e-e42df4192f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08715bf0-8f47-4393-bf9e-e42df4192f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fd48c-6014-4222-93d9-7dd22f732e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fd48c-6014-4222-93d9-7dd22f732e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4184b88-a19b-4353-b967-be49e5d30b9b', 'volume_name': 'volume-d4184b88-a19b-4353-b967-be49e5d30b9b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa472be-f830-41e7-8f03-3a325db10997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa472be-f830-41e7-8f03-3a325db10997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7642fc6-9c55-4a6c-8fbe-395e4dc3a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Volume d4184b88-a19b-4353-b967-be49e5d30b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4184b88-a19b-4353-b967-be49e5d30b9b', 'volume_size': 1} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-464911996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4184b88-a19b-4353-b967-be49e5d30b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01555273120a4833bdadea3352bb8f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:01Z,use_quota=True,user_id='1d39f2459bc14a3cb731ab6216ead81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Creating volume d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:19:01 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:19:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:01 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b 1073741824 Jul 14 20:19:01 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:02 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b 1073741824" returned: 0 in 0.538s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:02 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b Jul 14 20:19:02 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:02 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b" returned: 0 in 0.336s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7642fc6-9c55-4a6c-8fbe-395e4dc3a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4184b88-a19b-4353-b967-be49e5d30b9b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b797a8f-ad63-4cd4-a141-378d342ba10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Volume volume-d4184b88-a19b-4353-b967-be49e5d30b9b (d4184b88-a19b-4353-b967-be49e5d30b9b): created successfully Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b797a8f-ad63-4cd4-a141-378d342ba10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Flow 'volume_create_manager' (cb6e229e-138a-4d04-9bda-b148cd103ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e2e8f82e-4a0b-494e-b274-049675aa04cb tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Created volume successfully. Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:03 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:19:03 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:03 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.448s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Creating offline snapshot 5ab31818-8eb6-4e96-9aec-155a339f532d of volume d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddc51e-29c7-45b4-be56-40c17154012f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:04 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b Jul 14 20:19:04 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:04 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:04 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d 1G Jul 14 20:19:04 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:04 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d 1G" returned: 0 in 0.488s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4184b88-a19b-4353-b967-be49e5d30b9b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:04 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4184b88-a19b-4353-b967-be49e5d30b9b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d Jul 14 20:19:04 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:05 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4184b88-a19b-4353-b967-be49e5d30b9b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:05 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d is being set with open permissions: ugo+rw Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:05 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d Jul 14 20:19:05 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:05 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:05 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info Jul 14 20:19:05 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:05 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:05 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info is being set with open permissions: ugo+rw Jul 14 20:19:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:05 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info Jul 14 20:19:05 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:06 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.info" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-42ddfa07-e2d3-4ffb-b30f-9daa8f634384 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Create snapshot completed successfully Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "cinder-5ab31818-8eb6-4e96-9aec-155a339f532d-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-5ab31818-8eb6-4e96-9aec-155a339f532d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "cinder-quobyte-5ab31818-8eb6-4e96-9aec-155a339f532d" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-5ab31818-8eb6-4e96-9aec-155a339f532d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Deleting offline snapshot 5ab31818-8eb6-4e96-9aec-155a339f532d of volume d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] snapshot_file for this snap is: volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b80056-b2c9-4051-ac58-68c0134d1cac]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:07 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d Jul 14 20:19:07 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:08 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d" returned: 0 in 0.420s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4184b88-a19b-4353-b967-be49e5d30b9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535417b-ddf3-4523-bbe5-5d18d04469ec]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:08 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b Jul 14 20:19:08 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:08 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b" returned: 0 in 0.431s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:08 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d Jul 14 20:19:08 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:08 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d" returned: 0 in 0.457s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:09 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d Jul 14 20:19:09 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:09 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b.5ab31818-8eb6-4e96-9aec-155a339f532d" returned: 0 in 0.283s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-5ab31818-8eb6-4e96-9aec-155a339f532d" released by "_delete_snapshot" :: held 1.731s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" released by "delete_snapshot" :: held 1.759s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:09 devstack cinder-volume[87600]: WARNING cinder.quota [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Created reservations ['04cb58fa-ca59-4c4e-a471-0feab11008d1', '87b563c2-aca4-41bf-a97b-7d2b31cdc418', '846b187e-5ee6-497e-946a-e409d3e46ba1', '77c5f27c-da30-47cd-a1f4-41a2b4b5f35a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:19:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Delete snapshot completed successfully. Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c397a9ac-113f-4628-b270-6af6a66cc061 tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-5ab31818-8eb6-4e96-9aec-155a339f532d-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "cinder-d4184b88-a19b-4353-b967-be49e5d30b9b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-d4184b88-a19b-4353-b967-be49e5d30b9b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a52817-7f31-4337-b2d0-db9ca9494136]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:10 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b Jul 14 20:19:10 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:10 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:10 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b Jul 14 20:19:10 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:10 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d4184b88-a19b-4353-b967-be49e5d30b9b" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-quobyte-d4184b88-a19b-4353-b967-be49e5d30b9b" released by "delete_volume" :: held 0.969s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Created reservations ['d6145ebe-9019-4f62-9aaa-6968317e8fbe', '3fdc7010-8c50-4fbf-ae64-ed3aa5471ab1', '56a2ae92-4eb3-4a7f-a6c5-bc13b22975e1', '4a8c7afc-d9dd-486f-9fdb-99981c18784c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:11 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:19:11 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:11 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.380s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:19:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Deleted volume successfully. Jul 14 20:19:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d07141f5-5b41-4ec6-9d78-3eea7ec58c4b tempest-VolumeSnapshotQuotasNegativeTestJSON-833306937 None] Lock "cinder-d4184b88-a19b-4353-b967-be49e5d30b9b-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:21 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:19:21 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Flow 'volume_create_manager' (533b862b-9fd9-4bba-a5db-2873fe8b8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929cb111-a0b7-4111-bad3-68c892c53247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929cb111-a0b7-4111-bad3-68c892c53247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-710118246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde9b3d2-1e06-486a-86fa-9558c051faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae78319844fd0a8cfe0a4be015484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:23Z,use_quota=True,user_id='d5402fc8fa1a416eab3a94450868db57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(260350c6-5046-4ac7-9d7d-92bd14964d5e),volume_type_id=260350c6-5046-4ac7-9d7d-92bd14964d5e)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8af0ba-0794-437e-9efb-7b35618edaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8af0ba-0794-437e-9efb-7b35618edaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f760d60-feb8-4b9b-a790-51eb7781cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f760d60-feb8-4b9b-a790-51eb7781cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde9b3d2-1e06-486a-86fa-9558c051faa7', 'volume_name': 'volume-cde9b3d2-1e06-486a-86fa-9558c051faa7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44127bd-4717-4e3b-adb6-71f0b8097620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44127bd-4717-4e3b-adb6-71f0b8097620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45acf11a-e9a5-4ee5-b9e7-c2472f216ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Volume cde9b3d2-1e06-486a-86fa-9558c051faa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde9b3d2-1e06-486a-86fa-9558c051faa7', 'volume_size': 1} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-710118246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde9b3d2-1e06-486a-86fa-9558c051faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae78319844fd0a8cfe0a4be015484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:23Z,use_quota=True,user_id='d5402fc8fa1a416eab3a94450868db57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(260350c6-5046-4ac7-9d7d-92bd14964d5e),volume_type_id=260350c6-5046-4ac7-9d7d-92bd14964d5e)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Creating volume cde9b3d2-1e06-486a-86fa-9558c051faa7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:19:22 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:19:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:22 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 1073741824 Jul 14 20:19:22 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:23 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 1073741824" returned: 0 in 0.745s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:23 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 Jul 14 20:19:23 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:23 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7" returned: 0 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45acf11a-e9a5-4ee5-b9e7-c2472f216ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde9b3d2-1e06-486a-86fa-9558c051faa7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4705af-64c6-4793-9e70-0e7ea8a27dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Volume volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 (cde9b3d2-1e06-486a-86fa-9558c051faa7): created successfully Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4705af-64c6-4793-9e70-0e7ea8a27dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Flow 'volume_create_manager' (533b862b-9fd9-4bba-a5db-2873fe8b8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3359dc93-40c2-4de9-9e82-ed66bf78690e tempest-VolumeTypesAccessTest-1813488553 None] Created volume successfully. Jul 14 20:19:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Acquiring lock "cinder-cde9b3d2-1e06-486a-86fa-9558c051faa7-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "cinder-cde9b3d2-1e06-486a-86fa-9558c051faa7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Acquiring lock "cinder-quobyte-cde9b3d2-1e06-486a-86fa-9558c051faa7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "cinder-quobyte-cde9b3d2-1e06-486a-86fa-9558c051faa7" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472ccd9-1626-4230-866a-972f3b3564da]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:25 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 Jul 14 20:19:25 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:25 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7" returned: 0 in 0.638s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:25 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7 Jul 14 20:19:25 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:26 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cde9b3d2-1e06-486a-86fa-9558c051faa7" returned: 0 in 0.344s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "cinder-quobyte-cde9b3d2-1e06-486a-86fa-9558c051faa7" released by "delete_volume" :: held 1.044s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:26 devstack cinder-volume[87600]: WARNING cinder.quota [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-293442146 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-293442146, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:19:26 devstack cinder-volume[87600]: WARNING cinder.quota [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-293442146 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-293442146, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Created reservations ['9f529120-87be-4ea5-a5fc-e37271a058c6', '829c07f5-ac80-40ce-8ef2-34d600050663', 'e4f6a377-c6a0-4c9b-ad7e-7e79007226c2', 'a2aa75da-d74a-4942-9a2b-8fd5fb30f5f3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:26 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:19:26 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:26 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:19:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Deleted volume successfully. Jul 14 20:19:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2581fcea-4138-4e6a-a511-d032273afa20 tempest-VolumeTypesAccessTest-1813488553 None] Lock "cinder-cde9b3d2-1e06-486a-86fa-9558c051faa7-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:19:36 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:19:36 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=14,cinder:INSERT=3,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (e35d3135-8d59-4e9f-99b2-2f92e411f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a9cca8-09ba-44dc-b659-a6dc74f8b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a9cca8-09ba-44dc-b659-a6dc74f8b552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-62735699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bb63f-19b8-4e75-93e2-11e04bfcc657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:46Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bdc7d6-0de2-40ed-8915-f75ff7533adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bdc7d6-0de2-40ed-8915-f75ff7533adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357d18c4-fb3a-4bb3-ad07-9ee055b488fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357d18c4-fb3a-4bb3-ad07-9ee055b488fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53bb63f-19b8-4e75-93e2-11e04bfcc657', 'volume_name': 'volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e9f450-a64b-4d42-bcef-4e719a71a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e9f450-a64b-4d42-bcef-4e719a71a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc554c75-e8fa-4b86-bafa-419aa639997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Volume e53bb63f-19b8-4e75-93e2-11e04bfcc657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657', 'volume_size': 1} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-62735699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bb63f-19b8-4e75-93e2-11e04bfcc657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:46Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Creating volume e53bb63f-19b8-4e75-93e2-11e04bfcc657 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:19:46 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:19:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:47 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 1073741824 Jul 14 20:19:47 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:47 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 1073741824" returned: 0 in 0.676s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:47 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 Jul 14 20:19:47 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:48 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657" returned: 0 in 0.506s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc554c75-e8fa-4b86-bafa-419aa639997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df4c60a-01ea-44b3-9214-0fcba1ef3ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Volume volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 (e53bb63f-19b8-4e75-93e2-11e04bfcc657): created successfully Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df4c60a-01ea-44b3-9214-0fcba1ef3ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (e35d3135-8d59-4e9f-99b2-2f92e411f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d0e66151-0ff8-401c-b793-d3a1f13c3689 tempest-AttachVolumeTestJSON-877122130 None] Created volume successfully. Jul 14 20:19:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d2780-410c-4928-8b02-30e553354743]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:19:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:50 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 Jul 14 20:19:50 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:50 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657" returned: 0 in 0.617s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.653s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b8a1477-2a8b-4d4a-a98c-dbae0b0cfa77', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:19:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-f20b30cf-9495-423d-89f1-26882aa7e220 req-0eed9e27-47de-4465-aa3b-09c477a9384a tempest-AttachVolumeTestJSON-877122130 None] attachment_update completed successfully. Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (48a48410-cac4-4477-b2f6-d034da59552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0d413-ba1b-4e97-8215-51f3ce8b19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0d413-ba1b-4e97-8215-51f3ce8b19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-926721330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0ec9d8-252d-4f0b-908f-93d783bfd13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:59Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed6019d-cf83-47c0-8707-8337c2ed252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed6019d-cf83-47c0-8707-8337c2ed252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78bf21a-c6e1-47c9-83cc-24f0fadd946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78bf21a-c6e1-47c9-83cc-24f0fadd946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0ec9d8-252d-4f0b-908f-93d783bfd13e', 'volume_name': 'volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb0f59d-7e3c-406c-85bb-1adb9211d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb0f59d-7e3c-406c-85bb-1adb9211d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e8c98c-d052-443f-98c1-c5de634bc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:19:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Volume 9f0ec9d8-252d-4f0b-908f-93d783bfd13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e', 'volume_size': 1} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-926721330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0ec9d8-252d-4f0b-908f-93d783bfd13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:19:59Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:19:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Creating volume 9f0ec9d8-252d-4f0b-908f-93d783bfd13e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:19:59 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:59 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e 1073741824 Jul 14 20:19:59 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:19:59 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e 1073741824" returned: 0 in 0.733s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:19:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:19:59 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e Jul 14 20:19:59 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:00 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e8c98c-d052-443f-98c1-c5de634bc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe60b153-564a-4a10-a94d-a1b6b5313dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Volume volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e (9f0ec9d8-252d-4f0b-908f-93d783bfd13e): created successfully Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe60b153-564a-4a10-a94d-a1b6b5313dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (48a48410-cac4-4477-b2f6-d034da59552f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-29a958ae-750e-4edd-9c92-6b36051030db tempest-AttachVolumeNegativeTest-31222840 None] Created volume successfully. Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Flow 'volume_create_manager' (22f11d6c-9720-4117-830f-469627aa900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be033e-9dcb-45c4-8d88-42652de80a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be033e-9dcb-45c4-8d88-42652de80a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794720580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351d25b7-d986-4176-a747-b28ce9d4991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44a65dd7cb46a79f3aac9fbd0c6a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:03Z,use_quota=True,user_id='79d68317f5e34439b2f92f6e2de2c375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9351e04-6095-459a-af9e-d85577b1e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9351e04-6095-459a-af9e-d85577b1e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd912ae3-4fa5-4fd8-a66c-05ab772e90f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd912ae3-4fa5-4fd8-a66c-05ab772e90f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351d25b7-d986-4176-a747-b28ce9d4991f', 'volume_name': 'volume-351d25b7-d986-4176-a747-b28ce9d4991f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033902e6-e756-491b-a06a-cdc5d271ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033902e6-e756-491b-a06a-cdc5d271ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9277c179-7b45-4c5d-b0c3-1de72349f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Volume 351d25b7-d986-4176-a747-b28ce9d4991f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351d25b7-d986-4176-a747-b28ce9d4991f', 'volume_size': 1} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-794720580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351d25b7-d986-4176-a747-b28ce9d4991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44a65dd7cb46a79f3aac9fbd0c6a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:03Z,use_quota=True,user_id='79d68317f5e34439b2f92f6e2de2c375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Creating volume 351d25b7-d986-4176-a747-b28ce9d4991f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:03 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f 1073741824 Jul 14 20:20:03 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:03 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:03 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:03 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.526s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 8 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:20:03 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f 1073741824" returned: 0 in 0.943s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:04 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f Jul 14 20:20:04 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:04 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f" returned: 0 in 0.444s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.323s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9277c179-7b45-4c5d-b0c3-1de72349f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351d25b7-d986-4176-a747-b28ce9d4991f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36022492-93c3-468b-967b-c814f6d6f5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[558034e7-6cbe-443c-b66d-8c07466ad146]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Volume volume-351d25b7-d986-4176-a747-b28ce9d4991f (351d25b7-d986-4176-a747-b28ce9d4991f): created successfully Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36022492-93c3-468b-967b-c814f6d6f5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Flow 'volume_create_manager' (22f11d6c-9720-4117-830f-469627aa900a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-92e9856b-b75e-4932-9288-3e58d86b2fab tempest-ServersNegativeTestJSON-1901250571 None] Created volume successfully. Jul 14 20:20:04 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e Jul 14 20:20:04 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:05 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" returned: 0 in 0.811s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '084a4467-cd49-4119-8a11-f2928e306939', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:20:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-f7fcc669-205d-47b1-9de2-279a1ddf2652 req-530d71fb-b350-4172-8af9-189dc6c952fb tempest-AttachVolumeNegativeTest-31222840 None] attachment_update completed successfully. Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Flow 'volume_create_manager' (f64c3841-251c-4bd8-8190-bc7e5131ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad0f95-4aa6-47ce-9850-98bd9af8b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad0f95-4aa6-47ce-9850-98bd9af8b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1323999302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e73712-dda4-4f50-b3b7-d463848d6557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44a65dd7cb46a79f3aac9fbd0c6a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:10Z,use_quota=True,user_id='79d68317f5e34439b2f92f6e2de2c375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41e6699-01c2-482d-9324-1c5cc2d86527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41e6699-01c2-482d-9324-1c5cc2d86527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272646b8-fd0a-48c2-9f83-bb3a250969ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272646b8-fd0a-48c2-9f83-bb3a250969ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e73712-dda4-4f50-b3b7-d463848d6557', 'volume_name': 'volume-d1e73712-dda4-4f50-b3b7-d463848d6557', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c33e50-e428-4f64-8052-2371c8246423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c33e50-e428-4f64-8052-2371c8246423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d283387-3daf-4d7d-820d-52d3daaa5f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:10 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Volume d1e73712-dda4-4f50-b3b7-d463848d6557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e73712-dda4-4f50-b3b7-d463848d6557', 'volume_size': 1} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1323999302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e73712-dda4-4f50-b3b7-d463848d6557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44a65dd7cb46a79f3aac9fbd0c6a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:10Z,use_quota=True,user_id='79d68317f5e34439b2f92f6e2de2c375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Creating volume d1e73712-dda4-4f50-b3b7-d463848d6557 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:10 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:10 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 1073741824 Jul 14 20:20:10 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:11 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 1073741824" returned: 0 in 0.577s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:11 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 Jul 14 20:20:11 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:11 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d283387-3daf-4d7d-820d-52d3daaa5f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e73712-dda4-4f50-b3b7-d463848d6557', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d483b570-95ed-4093-acab-b55cd7d7c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:11 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Volume volume-d1e73712-dda4-4f50-b3b7-d463848d6557 (d1e73712-dda4-4f50-b3b7-d463848d6557): created successfully Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d483b570-95ed-4093-acab-b55cd7d7c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Flow 'volume_create_manager' (f64c3841-251c-4bd8-8190-bc7e5131ca90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1b344ddd-4af0-4bb2-872b-12dcba73987f tempest-ServersNegativeTestJSON-1901250571 None] Created volume successfully. Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "cinder-d1e73712-dda4-4f50-b3b7-d463848d6557-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-d1e73712-dda4-4f50-b3b7-d463848d6557-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "cinder-quobyte-d1e73712-dda4-4f50-b3b7-d463848d6557" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-quobyte-d1e73712-dda4-4f50-b3b7-d463848d6557" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff5631-12c9-4814-98dc-5af4ae06ae77]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:13 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 Jul 14 20:20:13 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:14 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557" returned: 0 in 0.571s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:14 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557 Jul 14 20:20:14 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:14 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d1e73712-dda4-4f50-b3b7-d463848d6557" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-quobyte-d1e73712-dda4-4f50-b3b7-d463848d6557" released by "delete_volume" :: held 0.999s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Created reservations ['2dc1a827-0d82-4f4d-ac37-d80c25d0cf49', 'a0b8b18d-661c-4f4b-8332-459948ad1540', 'a845a4a1-a0d5-4199-bad5-c7cd002d8e8e', '9891559d-fa40-4649-9bd3-d2c9dbf08cdc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:14 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:14 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:15 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.338s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Deleted volume successfully. Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-024a22c7-3267-41ca-bc40-c36ca6e9b136 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-d1e73712-dda4-4f50-b3b7-d463848d6557-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "cinder-351d25b7-d986-4176-a747-b28ce9d4991f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-351d25b7-d986-4176-a747-b28ce9d4991f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "cinder-quobyte-351d25b7-d986-4176-a747-b28ce9d4991f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-quobyte-351d25b7-d986-4176-a747-b28ce9d4991f" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2578bc-9fc0-4978-b95d-088d9c854882]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:16 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f Jul 14 20:20:16 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:16 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f" returned: 0 in 0.608s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:16 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f Jul 14 20:20:16 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:16 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-351d25b7-d986-4176-a747-b28ce9d4991f" returned: 0 in 0.415s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-quobyte-351d25b7-d986-4176-a747-b28ce9d4991f" released by "delete_volume" :: held 1.088s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Created reservations ['c244accd-afc6-4f05-b65d-9626d03bc94e', '383b5491-b764-4864-809d-fc33b21fbd3e', 'decb25b8-dc80-40ac-b560-cb9ecb5a3710', '8f98a56e-2bdd-4a7b-b0de-d83e74076e9b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:17 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:17 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:17 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Deleted volume successfully. Jul 14 20:20:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-12616d27-8e78-4e8d-85cd-7724dbc82635 tempest-ServersNegativeTestJSON-1901250571 None] Lock "cinder-351d25b7-d986-4176-a747-b28ce9d4991f-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:27 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=33,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:20:27 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=34,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:20:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-110c84cb-a9ee-45eb-a5b2-3c152d7719af req-b4496e14-2fd0-461e-847e-beb2210d2fd2 tempest-AttachVolumeTestJSON-877122130 None] Terminate volume connection completed successfully. Jul 14 20:20:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-110c84cb-a9ee-45eb-a5b2-3c152d7719af req-b4496e14-2fd0-461e-847e-beb2210d2fd2 tempest-AttachVolumeTestJSON-877122130 None] Deleting attachment 6b8a1477-2a8b-4d4a-a98c-dbae0b0cfa77. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Flow 'volume_create_manager' (cfc3162a-c120-48e0-b1ba-0d1daf7e2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6cdb96-f21a-484f-9067-661295dd9aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6cdb96-f21a-484f-9067-661295dd9aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1838086920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59185d5c-c023-42f4-8d46-fe1de5de3587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f4694306b242c895950f5accc373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:33Z,use_quota=True,user_id='f7bd4386ba4040b89b612106c582121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c717ad-2b61-419e-9002-1721f691cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c717ad-2b61-419e-9002-1721f691cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ba4797-baec-44e4-b77e-559812ee468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ba4797-baec-44e4-b77e-559812ee468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59185d5c-c023-42f4-8d46-fe1de5de3587', 'volume_name': 'volume-59185d5c-c023-42f4-8d46-fe1de5de3587', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85eb2fa0-b0be-4533-8be0-b656e4dc7778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85eb2fa0-b0be-4533-8be0-b656e4dc7778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83e6ce5-3b04-4e0f-bb5d-9e7475d933e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Volume 59185d5c-c023-42f4-8d46-fe1de5de3587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59185d5c-c023-42f4-8d46-fe1de5de3587', 'volume_size': 1} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1838086920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59185d5c-c023-42f4-8d46-fe1de5de3587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f4694306b242c895950f5accc373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:33Z,use_quota=True,user_id='f7bd4386ba4040b89b612106c582121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Creating volume 59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:32 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:32 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 1073741824 Jul 14 20:20:32 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:33 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 1073741824" returned: 0 in 0.784s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:33 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 Jul 14 20:20:33 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:34 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587" returned: 0 in 0.481s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83e6ce5-3b04-4e0f-bb5d-9e7475d933e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59185d5c-c023-42f4-8d46-fe1de5de3587', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42147d6f-360b-4bf7-b8c7-167d7d685b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:34 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Volume volume-59185d5c-c023-42f4-8d46-fe1de5de3587 (59185d5c-c023-42f4-8d46-fe1de5de3587): created successfully Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42147d6f-360b-4bf7-b8c7-167d7d685b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Flow 'volume_create_manager' (cfc3162a-c120-48e0-b1ba-0d1daf7e2370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-213dc859-4961-43fd-a053-87ddf8f01021 req-6fc0611f-4f5e-45c4-bad7-b3de61591bd5 tempest-VolumesSnapshotsTestJSON-1665612054 None] Created volume successfully. Jul 14 20:20:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Creating offline snapshot 62018618-a8ae-4304-be50-3512e97a3415 of volume 59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:20:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dfb406-3ad7-431b-9a41-1b9488c4c793]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:36 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 Jul 14 20:20:36 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:37 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587" returned: 0 in 1.111s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:37 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 1G Jul 14 20:20:37 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:37 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 1G" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59185d5c-c023-42f4-8d46-fe1de5de3587 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:37 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59185d5c-c023-42f4-8d46-fe1de5de3587 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 Jul 14 20:20:37 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:37 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59185d5c-c023-42f4-8d46-fe1de5de3587 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415" returned: 0 in 0.474s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:37 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 is being set with open permissions: ugo+rw Jul 14 20:20:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:37 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 Jul 14 20:20:37 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:38 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415" returned: 0 in 0.374s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:38 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info Jul 14 20:20:38 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:38 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info" returned: 0 in 0.482s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:38 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info is being set with open permissions: ugo+rw Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:38 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info Jul 14 20:20:38 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (7f594791-b7e4-4c2d-97c0-04c52a03e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b03cbe-9946-41db-9a07-0879e24e0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b03cbe-9946-41db-9a07-0879e24e0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459718851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a355e9-adad-448d-a8f8-334564475ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:39Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81610cc4-be44-4f7d-b38d-831fb6ebed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81610cc4-be44-4f7d-b38d-831fb6ebed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c051d-bbec-4348-8ec5-c863c4a1acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c051d-bbec-4348-8ec5-c863c4a1acce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a355e9-adad-448d-a8f8-334564475ef5', 'volume_name': 'volume-98a355e9-adad-448d-a8f8-334564475ef5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e757173-8d48-4de4-82fa-09a52d86f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e757173-8d48-4de4-82fa-09a52d86f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8d3be2-15a3-4deb-a1db-97fdbb5c8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:39 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Volume 98a355e9-adad-448d-a8f8-334564475ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a355e9-adad-448d-a8f8-334564475ef5', 'volume_size': 1} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:39 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.info" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.513s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.200s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459718851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a355e9-adad-448d-a8f8-334564475ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:39Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Creating volume 98a355e9-adad-448d-a8f8-334564475ef5 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:39 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:39 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 1073741824 Jul 14 20:20:39 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-9209b096-58aa-4fef-a3a3-6da98f1b542c req-9226c66f-2d33-4e44-9bd0-7c05fa9c8fef tempest-VolumesSnapshotsTestJSON-1665612054 None] Create snapshot completed successfully Jul 14 20:20:39 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 1073741824" returned: 0 in 0.522s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:39 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 Jul 14 20:20:39 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:40 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5" returned: 0 in 0.295s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8d3be2-15a3-4deb-a1db-97fdbb5c8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a355e9-adad-448d-a8f8-334564475ef5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fad619f-caad-42d3-89f0-ef7f6ed03c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:40 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Volume volume-98a355e9-adad-448d-a8f8-334564475ef5 (98a355e9-adad-448d-a8f8-334564475ef5): created successfully Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fad619f-caad-42d3-89f0-ef7f6ed03c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (7f594791-b7e4-4c2d-97c0-04c52a03e298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1ac679ae-c3b8-40bf-a54d-478bce5badbd tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "cinder-62018618-a8ae-4304-be50-3512e97a3415-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-62018618-a8ae-4304-be50-3512e97a3415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "cinder-quobyte-62018618-a8ae-4304-be50-3512e97a3415" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-62018618-a8ae-4304-be50-3512e97a3415" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Deleting offline snapshot 62018618-a8ae-4304-be50-3512e97a3415 of volume 59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] snapshot_file for this snap is: volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e3c82-3b79-46c0-87f2-ee343e8d3f28]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:40 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 Jul 14 20:20:40 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0cc1da63-45c9-4cd1-ae5d-c29cf6e225e0 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5" by "attach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0cc1da63-45c9-4cd1-ae5d-c29cf6e225e0 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5" acquired by "attach_volume" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0cc1da63-45c9-4cd1-ae5d-c29cf6e225e0 tempest-VolumesActionsTest-2077656939 None] Attaching volume 98a355e9-adad-448d-a8f8-334564475ef5 to instance 266fb6e9-9774-47e1-bc02-6448f9b56b08 at mountpoint /dev/vdb on host None. Jul 14 20:20:41 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0cc1da63-45c9-4cd1-ae5d-c29cf6e225e0 tempest-VolumesActionsTest-2077656939 None] Attach volume completed successfully. Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415" returned: 0 in 0.522s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59185d5c-c023-42f4-8d46-fe1de5de3587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0cc1da63-45c9-4cd1-ae5d-c29cf6e225e0 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5" released by "attach_volume" :: held 0.188s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b88d8-9077-4c1c-8ad6-bbb56478e1ae]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:41 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 Jul 14 20:20:41 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:41 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587" returned: 0 in 0.522s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:41 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 Jul 14 20:20:41 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Terminate volume connection completed successfully. Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" by "detach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:42 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415" returned: 0 in 0.423s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Detaching volume 98a355e9-adad-448d-a8f8-334564475ef5 from instance 266fb6e9-9774-47e1-bc02-6448f9b56b08. Jul 14 20:20:42 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415 Jul 14 20:20:42 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Detach volume completed successfully. Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-320cf591-c1c3-46c4-801d-c84e5fe811fb tempest-VolumesActionsTest-546733851 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:42 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587.62018618-a8ae-4304-be50-3512e97a3415" returned: 0 in 0.314s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1f97197c-7b61-4c55-aa7c-0f257ceb35ae tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" by "detach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-62018618-a8ae-4304-be50-3512e97a3415" released by "_delete_snapshot" :: held 1.900s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" released by "delete_snapshot" :: held 1.937s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1f97197c-7b61-4c55-aa7c-0f257ceb35ae tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1f97197c-7b61-4c55-aa7c-0f257ceb35ae tempest-VolumesActionsTest-2077656939 None] Volume detach called, but volume not attached. Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1f97197c-7b61-4c55-aa7c-0f257ceb35ae tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.quota [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Created reservations ['5bef31ae-41f8-4f9a-845b-76d08f881c6a', 'd3cd3bca-7480-4c96-a9e0-ae75377c541a', 'adfd3784-9bb4-4355-8d6c-7cff78af1292', '950e922c-0c00-465e-a44d-a5f373b95b59'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Delete snapshot completed successfully. Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ac3f9836-93d9-41dd-afe9-601f9d2e6132 req-a45f2971-e7c1-4b8e-a3ba-9c2fbadcac82 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-62018618-a8ae-4304-be50-3512e97a3415-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "cinder-59185d5c-c023-42f4-8d46-fe1de5de3587-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-59185d5c-c023-42f4-8d46-fe1de5de3587-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88acbe2-7e17-4327-856e-370e7b73eb9e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-quobyte-98a355e9-adad-448d-a8f8-334564475ef5" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "cinder-quobyte-98a355e9-adad-448d-a8f8-334564475ef5" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb602e74-d540-4ae7-aa4d-367eb032225b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:43 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 Jul 14 20:20:43 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:43 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 Jul 14 20:20:43 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:43 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5" returned: 0 in 0.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:43 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5 Jul 14 20:20:43 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:43 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587" returned: 0 in 0.575s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:43 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587 Jul 14 20:20:43 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:43 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-98a355e9-adad-448d-a8f8-334564475ef5" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:43 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-59185d5c-c023-42f4-8d46-fe1de5de3587" returned: 0 in 0.288s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "cinder-quobyte-98a355e9-adad-448d-a8f8-334564475ef5" released by "delete_volume" :: held 0.837s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-quobyte-59185d5c-c023-42f4-8d46-fe1de5de3587" released by "delete_volume" :: held 0.937s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Created reservations ['ffa85f1a-b52d-473d-86ad-1161e15b3bd8', 'd148d478-d342-44aa-bcb3-92a20c721dae', '7cd3df7c-f8cf-4783-a59a-413030f6b57c', 'ce1594b6-7a20-4330-90cc-f355567a672a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:43 devstack cinder-volume[87600]: DEBUG cinder.quota [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Created reservations ['9ba27bc7-e5c7-48a4-8636-b486583e97dd', '124a1ae7-e5cf-480f-8756-129db1eb7af4', '2119567a-1e08-4697-a678-6292f6bf45cc', '3c898cce-ec79-4bb4-a86a-2757a2a83dae'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:44 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:44 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:44 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:44 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:44 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.614s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:44 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Deleted volume successfully. Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.771s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.manager [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Deleted volume successfully. Jul 14 20:20:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-912ecf1b-c481-495b-91f0-f432323ea91d tempest-VolumesActionsTest-2077656939 None] Lock "cinder-98a355e9-adad-448d-a8f8-334564475ef5-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-861c300f-434b-40c9-8eda-c654f9c91cf8 req-11d63421-7d22-4f86-8007-b21d57e71750 tempest-VolumesSnapshotsTestJSON-1665612054 None] Lock "cinder-59185d5c-c023-42f4-8d46-fe1de5de3587-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (da72c709-097b-47d0-b3a5-1975ca53331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d26bf3-1c1e-4638-af78-c71983ad1dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d26bf3-1c1e-4638-af78-c71983ad1dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055170967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a4250b-7831-41eb-b467-c376234d0d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:49Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef51279d-e437-4140-b153-47b067e4ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef51279d-e437-4140-b153-47b067e4ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e2a7f4-be19-4304-ac22-bd9449813e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e2a7f4-be19-4304-ac22-bd9449813e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a4250b-7831-41eb-b467-c376234d0d6f', 'volume_name': 'volume-12a4250b-7831-41eb-b467-c376234d0d6f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95474d40-19ee-4180-8df0-3022bfca66bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95474d40-19ee-4180-8df0-3022bfca66bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a67960e-89da-4b0d-9fd7-25b00ec2d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Volume 12a4250b-7831-41eb-b467-c376234d0d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a4250b-7831-41eb-b467-c376234d0d6f', 'volume_size': 1} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055170967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a4250b-7831-41eb-b467-c376234d0d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:49Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Creating volume 12a4250b-7831-41eb-b467-c376234d0d6f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:49 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f 1073741824 Jul 14 20:20:49 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:50 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f 1073741824" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:50 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f Jul 14 20:20:50 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:50 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a67960e-89da-4b0d-9fd7-25b00ec2d86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a4250b-7831-41eb-b467-c376234d0d6f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a918f0-561a-4076-a612-a95dddf7c314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Volume volume-12a4250b-7831-41eb-b467-c376234d0d6f (12a4250b-7831-41eb-b467-c376234d0d6f): created successfully Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a918f0-561a-4076-a612-a95dddf7c314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (da72c709-097b-47d0-b3a5-1975ca53331d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3bfab783-bf31-4f68-be78-0212ef3b381a tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:20:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-702347b7-0ad7-4603-b1dc-c2f5691f245f tempest-GroupSnapshotsV319Test-529754151 None] Group tempest-GroupSnapshotsV319Test-Group-353980439: creating Jul 14 20:20:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-702347b7-0ad7-4603-b1dc-c2f5691f245f tempest-GroupSnapshotsV319Test-529754151 None] Group tempest-GroupSnapshotsV319Test-Group-353980439: created successfully Jul 14 20:20:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-702347b7-0ad7-4603-b1dc-c2f5691f245f tempest-GroupSnapshotsV319Test-529754151 None] Create group completed successfully. Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-12a4250b-7831-41eb-b467-c376234d0d6f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "cinder-12a4250b-7831-41eb-b467-c376234d0d6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-quobyte-12a4250b-7831-41eb-b467-c376234d0d6f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-12a4250b-7831-41eb-b467-c376234d0d6f" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a34ed-46ca-4405-a5d0-36147311cbc8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:52 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f Jul 14 20:20:52 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:52 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f" returned: 0 in 0.414s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:52 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f Jul 14 20:20:52 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-814a75ea-5da4-4c18-9254-821d4d515fca req-a68611b2-8810-4b22-a1aa-020b399bb93c tempest-AttachVolumeNegativeTest-31222840 None] Terminate volume connection completed successfully. Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-814a75ea-5da4-4c18-9254-821d4d515fca req-a68611b2-8810-4b22-a1aa-020b399bb93c tempest-AttachVolumeNegativeTest-31222840 None] Deleting attachment 084a4467-cd49-4119-8a11-f2928e306939. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:20:52 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-12a4250b-7831-41eb-b467-c376234d0d6f" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-12a4250b-7831-41eb-b467-c376234d0d6f" released by "delete_volume" :: held 0.739s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Created reservations ['a4fe6fa2-f2fc-48e9-9669-3fde3e95bfb0', '934ae047-d8c7-4c47-b40c-c23189ec10e6', 'ff9d3838-263b-4cdf-b298-cb9bdec17f2d', 'ee015098-6f6e-4470-8ee4-d0b7c537eec4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:52 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:52 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:53 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.298s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Deleted volume successfully. Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d14a1899-7ecf-4728-876e-634aa253426c tempest-VolumesActionsTest-546733851 None] Lock "cinder-12a4250b-7831-41eb-b467-c376234d0d6f-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Flow 'volume_create_manager' (7a75992a-bcc4-48da-83fa-34ce2ed8291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce68e252-2380-4408-b5ce-6df29682fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce68e252-2380-4408-b5ce-6df29682fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4266008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4155c162-1f75-4e4b-ae4b-2b7a19bd2afb,host='devstack@QuobyteHD#QuobyteHD',id=86ca902e-5923-4167-9e05-efd0c09104e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec4780c964fdba7d7b13b15ba99c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:53Z,use_quota=True,user_id='253925d568334c8388a7fb868d9f4ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3dfd57-b21a-4d62-b409-111706f26ac4),volume_type_id=0b3dfd57-b21a-4d62-b409-111706f26ac4)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464c856c-5c69-4c41-8cb6-d342fef45b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464c856c-5c69-4c41-8cb6-d342fef45b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed454f8-32fe-4f94-8ee8-acf0097337f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed454f8-32fe-4f94-8ee8-acf0097337f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ca902e-5923-4167-9e05-efd0c09104e9', 'volume_name': 'volume-86ca902e-5923-4167-9e05-efd0c09104e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0439e9d0-1c77-4b3c-82a2-3ba702c134e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0439e9d0-1c77-4b3c-82a2-3ba702c134e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe59e0-52fc-4776-acf3-d38653ffc538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Volume 86ca902e-5923-4167-9e05-efd0c09104e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ca902e-5923-4167-9e05-efd0c09104e9', 'volume_size': 1} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4155c162-1f75-4e4b-ae4b-2b7a19bd2afb,created_at=2026-07-14T18:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4266008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4155c162-1f75-4e4b-ae4b-2b7a19bd2afb,host='devstack@QuobyteHD#QuobyteHD',id=86ca902e-5923-4167-9e05-efd0c09104e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec4780c964fdba7d7b13b15ba99c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:53Z,use_quota=True,user_id='253925d568334c8388a7fb868d9f4ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3dfd57-b21a-4d62-b409-111706f26ac4),volume_type_id=0b3dfd57-b21a-4d62-b409-111706f26ac4)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Creating volume 86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:53 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:53 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 1073741824 Jul 14 20:20:53 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (ac837439-eb83-4828-b8d9-f8773dea7f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb3b091-84cc-40d1-9410-dad619f213e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb3b091-84cc-40d1-9410-dad619f213e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024278754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98a7f1c-38bf-4f62-b9b1-7a483983391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:54Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb06492-62df-458f-b6d4-776b7d2de622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb06492-62df-458f-b6d4-776b7d2de622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c235f96-c1cc-438c-aeaa-6cdb0eee6255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c235f96-c1cc-438c-aeaa-6cdb0eee6255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98a7f1c-38bf-4f62-b9b1-7a483983391a', 'volume_name': 'volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54189be6-4d0b-4f6a-8157-e421c7ef4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54189be6-4d0b-4f6a-8157-e421c7ef4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bdb173-e81e-4751-8388-4bc055be831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Volume a98a7f1c-38bf-4f62-b9b1-7a483983391a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a', 'volume_size': 1} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:54 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 1073741824" returned: 0 in 0.842s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:54 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 Jul 14 20:20:54 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:54 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9" returned: 0 in 0.308s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024278754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98a7f1c-38bf-4f62-b9b1-7a483983391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:54Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Creating volume a98a7f1c-38bf-4f62-b9b1-7a483983391a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:54 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe59e0-52fc-4776-acf3-d38653ffc538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ca902e-5923-4167-9e05-efd0c09104e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0d4013-a0ba-43b8-8116-73964b10fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:54 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a 1073741824 Jul 14 20:20:54 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Volume volume-86ca902e-5923-4167-9e05-efd0c09104e9 (86ca902e-5923-4167-9e05-efd0c09104e9): created successfully Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0d4013-a0ba-43b8-8116-73964b10fa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Flow 'volume_create_manager' (7a75992a-bcc4-48da-83fa-34ce2ed8291e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e295d47c-bd38-438d-a2fc-2fb5efa350d9 tempest-GroupSnapshotsV319Test-529754151 None] Created volume successfully. Jul 14 20:20:55 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a 1073741824" returned: 0 in 0.497s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:55 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a Jul 14 20:20:55 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:55 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bdb173-e81e-4751-8388-4bc055be831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330ca12-20ac-4bbf-850e-3953f6c1f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Volume volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a (a98a7f1c-38bf-4f62-b9b1-7a483983391a): created successfully Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330ca12-20ac-4bbf-850e-3953f6c1f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (ac837439-eb83-4828-b8d9-f8773dea7f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-61181102-309d-4c94-a4c3-5c1014f6ce54 tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-a98a7f1c-38bf-4f62-b9b1-7a483983391a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "cinder-a98a7f1c-38bf-4f62-b9b1-7a483983391a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-quobyte-a98a7f1c-38bf-4f62-b9b1-7a483983391a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-a98a7f1c-38bf-4f62-b9b1-7a483983391a" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3036dae3-fbb3-4b0b-876d-90366737b4ff]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:56 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a Jul 14 20:20:56 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] GroupSnapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: creating. Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Group snapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: creating. {{(pid=87600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Creating offline snapshot 8c78d1a3-b048-418d-85a1-c205561b7402 of volume 86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[54981fe3-551e-476e-82d7-e9ecf2cf7ea0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:56 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:56 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 Jul 14 20:20:56 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:56 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a Jul 14 20:20:56 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:56 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a98a7f1c-38bf-4f62-b9b1-7a483983391a" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-a98a7f1c-38bf-4f62-b9b1-7a483983391a" released by "delete_volume" :: held 0.755s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:56 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9" returned: 0 in 0.446s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:57 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 1G Jul 14 20:20:57 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Created reservations ['2900a573-5c2c-44d5-8ef2-b43f927c0a5e', 'af685a74-98e9-4f0c-a10c-3b1d6414c23f', '644a82f0-52fc-41e9-87c9-f62035f59ed8', 'c012d571-5553-4f5a-a76c-1e0f8426872b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:57 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:20:57 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:57 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 1G" returned: 0 in 0.501s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ca902e-5923-4167-9e05-efd0c09104e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:57 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:20:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Deleted volume successfully. Jul 14 20:20:57 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ca902e-5923-4167-9e05-efd0c09104e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 Jul 14 20:20:57 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8812a286-3d66-4c02-a109-d9a3af6a230e tempest-VolumesActionsTest-546733851 None] Lock "cinder-a98a7f1c-38bf-4f62-b9b1-7a483983391a-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:20:57 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (0285e977-0472-442c-96b1-2e1d20a08170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:58 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0605a51-36dd-46c9-9987-9a1a0f87286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ca902e-5923-4167-9e05-efd0c09104e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402" returned: 0 in 0.548s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:58 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:58 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 Jul 14 20:20:58 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0605a51-36dd-46c9-9987-9a1a0f87286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1552bedb-daa1-4ae8-b937-d0ce0f95ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:58Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffd4418-ce91-4bf2-82e8-96aa2827dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffd4418-ce91-4bf2-82e8-96aa2827dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379e68c-5770-46f6-8f95-aaec0c392e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379e68c-5770-46f6-8f95-aaec0c392e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1552bedb-daa1-4ae8-b937-d0ce0f95ce12', 'volume_name': 'volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9464a39a-39a8-4501-8176-251754fde44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9464a39a-39a8-4501-8176-251754fde44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742863e5-5afb-4438-83c8-a74028f103b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Volume 1552bedb-daa1-4ae8-b937-d0ce0f95ce12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12', 'volume_size': 1} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:58 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402" returned: 0 in 0.304s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:58 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info Jul 14 20:20:58 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:58 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:58 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:58 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info Jul 14 20:20:58 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:58 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.info" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1552bedb-daa1-4ae8-b937-d0ce0f95ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:20:58Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Creating volume 1552bedb-daa1-4ae8-b937-d0ce0f95ce12 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:20:58 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:20:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:58 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 1073741824 Jul 14 20:20:58 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d053da64-7a8f-4aef-b65c-25facff16906 tempest-GroupSnapshotsV319Test-529754151 None] group_snapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: created successfully Jul 14 20:20:59 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 1073741824" returned: 0 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:20:59 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 Jul 14 20:20:59 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:20:59 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742863e5-5afb-4438-83c8-a74028f103b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d0cabb-0b68-403a-b2de-ff0bd3264f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:20:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Volume volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 (1552bedb-daa1-4ae8-b937-d0ce0f95ce12): created successfully Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d0cabb-0b68-403a-b2de-ff0bd3264f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:20:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (0285e977-0472-442c-96b1-2e1d20a08170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:20:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-34e834e2-b968-446f-88fc-c3d7b2e2498e tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:21:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] group_snapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: deleting Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] group_snapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: deleting {{(pid=87600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "cinder-quobyte-8c78d1a3-b048-418d-85a1-c205561b7402" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-8c78d1a3-b048-418d-85a1-c205561b7402" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Deleting offline snapshot 8c78d1a3-b048-418d-85a1-c205561b7402 of volume 86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] snapshot_file for this snap is: volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-1552bedb-daa1-4ae8-b937-d0ce0f95ce12-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a30fe5d-63d2-4a87-b99f-a8809db3ac4f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "cinder-1552bedb-daa1-4ae8-b937-d0ce0f95ce12-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-quobyte-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f410986-414e-4e29-9455-ed9e9d36e2cf]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:00 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 Jul 14 20:21:00 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:00 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 Jul 14 20:21:00 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:00 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402" returned: 0 in 0.686s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ca902e-5923-4167-9e05-efd0c09104e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f12dc-60d8-4b24-a75b-52908a22480d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:01 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" returned: 0 in 0.700s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:01 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 Jul 14 20:21:01 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:01 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12 Jul 14 20:21:01 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:01 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9" returned: 0 in 0.498s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:01 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:01 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 Jul 14 20:21:01 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-1552bedb-daa1-4ae8-b937-d0ce0f95ce12" released by "delete_volume" :: held 1.180s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Created reservations ['f40496f4-75b8-4236-82cb-9edf875256e7', '6e075d75-0c60-4e29-882c-47d5a9d5865b', '11cf367d-5a1b-43dd-bf29-de564217387a', 'ef71c5f2-6a95-4da7-a8a8-d6bc50cc2b69'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:01 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:01 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:02 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402" returned: 0 in 0.466s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:02 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402 Jul 14 20:21:02 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:02 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Deleted volume successfully. Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-10942a41-8d66-48c2-b6db-c39ed71b6b21 tempest-VolumesActionsTest-546733851 None] Lock "cinder-1552bedb-daa1-4ae8-b937-d0ce0f95ce12-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:02 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9.8c78d1a3-b048-418d-85a1-c205561b7402" returned: 0 in 0.346s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-8c78d1a3-b048-418d-85a1-c205561b7402" released by "_delete_snapshot" :: held 2.164s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" released by "delete_snapshot" :: held 2.195s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:02 devstack cinder-volume[87600]: WARNING cinder.quota [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1777064668 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1777064668, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:21:02 devstack cinder-volume[87600]: WARNING cinder.quota [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1777064668 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1777064668, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:21:02 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] Created reservations ['165f6b18-5c29-4a75-8d60-c9f4de771d4b', '33bbc81f-705f-4249-adb8-9c96a6b5a34b', '78d4a04b-dce6-4baa-be0f-5b43a3fafce4', '33245156-e783-418f-a3a6-d0ffad93b8e7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cd9aaf21-1f01-4d9f-ab38-0bce4ce481ce tempest-GroupSnapshotsV319Test-529754151 None] group_snapshot 6e12b7ae-331f-4460-98a7-dbef9147e5c3: deleted successfully Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:03 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:03 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (4a7df04c-932d-4ce1-875b-6bb833457cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197e9cff-e6bc-495a-a36a-fecea5982f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197e9cff-e6bc-495a-a36a-fecea5982f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986445795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c9df0e-3a73-4caf-ba7b-66cf8405862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:03Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226d355-4ed2-4021-9346-66afe1b5e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226d355-4ed2-4021-9346-66afe1b5e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0006f75f-ee97-4973-bc9b-9efb231cea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0006f75f-ee97-4973-bc9b-9efb231cea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c9df0e-3a73-4caf-ba7b-66cf8405862f', 'volume_name': 'volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b506bca-55bd-4946-aebd-79e9b23addf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b506bca-55bd-4946-aebd-79e9b23addf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfd49a6-c75f-4e4c-95b2-29431452b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Volume e4c9df0e-3a73-4caf-ba7b-66cf8405862f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f', 'volume_size': 1} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986445795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c9df0e-3a73-4caf-ba7b-66cf8405862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:03Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Creating volume e4c9df0e-3a73-4caf-ba7b-66cf8405862f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:03 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f 1073741824 Jul 14 20:21:03 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:03 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.307s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 8 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:21:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:21:04 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f 1073741824" returned: 0 in 0.713s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" acquired by "delete_volume" :: waited 0.047s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a8a0d-2282-4448-bb55-cf0178ab881d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:04 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f Jul 14 20:21:04 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:04 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 Jul 14 20:21:04 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:04 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfd49a6-c75f-4e4c-95b2-29431452b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c1f1c6-a12d-41e4-b48b-5fe3bccd27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Volume volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f (e4c9df0e-3a73-4caf-ba7b-66cf8405862f): created successfully Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c1f1c6-a12d-41e4-b48b-5fe3bccd27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (4a7df04c-932d-4ce1-875b-6bb833457cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-98b75425-cd82-4d58-9976-7f199f929b35 tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:21:04 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9" returned: 0 in 0.477s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:04 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9 Jul 14 20:21:04 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:05 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-86ca902e-5923-4167-9e05-efd0c09104e9" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Lock "cinder-quobyte-86ca902e-5923-4167-9e05-efd0c09104e9" released by "delete_volume" :: held 0.878s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Created reservations ['672803c9-0513-422e-8c40-d64f798f3211'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:05 devstack cinder-volume[87600]: WARNING cinder.quota [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1777064668 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1777064668, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Created reservations ['2193a76c-5938-4b0d-9531-6d22106c480e', 'b8aa799f-11d9-476f-860f-c6d196a170c4', '571358c7-d756-4e78-b338-7f4cfa56aa89', '503ecc5e-9bd0-47bb-a03d-40efa24d59a1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:05 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:05 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:05 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-e4c9df0e-3a73-4caf-ba7b-66cf8405862f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.422s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dbf41831-60cf-4597-b791-2573e546fc0c tempest-GroupSnapshotsV319Test-529754151 None] Delete group completed successfully. Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "cinder-e4c9df0e-3a73-4caf-ba7b-66cf8405862f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Acquiring lock "cinder-quobyte-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9f2bb-e590-450a-95f2-87faee21cd34]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:06 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f Jul 14 20:21:06 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:06 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" returned: 0 in 0.424s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:06 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f Jul 14 20:21:06 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:06 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" returned: 0 in 0.385s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "cinder-quobyte-e4c9df0e-3a73-4caf-ba7b-66cf8405862f" released by "delete_volume" :: held 0.870s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:06 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Created reservations ['804a373c-eac6-4868-8d2e-bef61f2d90e5', '47db69ba-fe43-451a-ad69-dcf0f0ba81b2', '61c5c2cf-6a22-4475-90ce-fd9efbbb7787', '6cd5ef5d-cc0b-4e7f-a0c0-e730092c2a22'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:07 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:07 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:07 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.364s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Deleted volume successfully. Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9fb07fab-e139-4399-beef-474ac8b35ea0 tempest-VolumesActionsTest-546733851 None] Lock "cinder-e4c9df0e-3a73-4caf-ba7b-66cf8405862f-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (af6aa5eb-4077-4557-8946-14a9b2426f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7dadea-5ab8-4a60-823a-866e557707c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7dadea-5ab8-4a60-823a-866e557707c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888524721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e23cf8-d86a-4599-8eed-072f3d0d7beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:08Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c0ab6-9ee2-4cca-b8f7-eae701e555f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c0ab6-9ee2-4cca-b8f7-eae701e555f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25581b1-782f-46d5-8bbe-100d65b315bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25581b1-782f-46d5-8bbe-100d65b315bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e23cf8-d86a-4599-8eed-072f3d0d7beb', 'volume_name': 'volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51db514-5a5b-47d0-9fa6-544028180241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51db514-5a5b-47d0-9fa6-544028180241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d341d4-f0d0-48e6-9180-2ae6bf2ae550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Volume 49e23cf8-d86a-4599-8eed-072f3d0d7beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb', 'volume_size': 1} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888524721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e23cf8-d86a-4599-8eed-072f3d0d7beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5a171614f408bbe97c1600ab341b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:08Z,use_quota=True,user_id='12286a9992414a2ab83d52fd5c73ab94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Creating volume 49e23cf8-d86a-4599-8eed-072f3d0d7beb {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:07 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:07 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb 1073741824 Jul 14 20:21:07 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:08 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb 1073741824" returned: 0 in 0.821s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:08 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb Jul 14 20:21:08 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:09 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb" returned: 0 in 0.503s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d341d4-f0d0-48e6-9180-2ae6bf2ae550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83acd4b7-2532-4466-9651-92ca0552408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:09 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Volume volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb (49e23cf8-d86a-4599-8eed-072f3d0d7beb): created successfully Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83acd4b7-2532-4466-9651-92ca0552408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Flow 'volume_create_manager' (af6aa5eb-4077-4557-8946-14a9b2426f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c3aa2400-7bc3-4e4d-b25b-d885c0cc6517 tempest-VolumesActionsTest-2077656939 None] Created volume successfully. Jul 14 20:21:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-49e23cf8-d86a-4599-8eed-072f3d0d7beb-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-49e23cf8-d86a-4599-8eed-072f3d0d7beb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "cinder-quobyte-49e23cf8-d86a-4599-8eed-072f3d0d7beb" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-quobyte-49e23cf8-d86a-4599-8eed-072f3d0d7beb" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded5a1b6-2d0e-4fed-bc52-f0a049cb6325]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:11 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb Jul 14 20:21:11 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:11 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb" returned: 0 in 0.511s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:11 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb Jul 14 20:21:11 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:12 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-49e23cf8-d86a-4599-8eed-072f3d0d7beb" returned: 0 in 0.574s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-quobyte-49e23cf8-d86a-4599-8eed-072f3d0d7beb" released by "delete_volume" :: held 1.157s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Created reservations ['45e1e6ff-2e27-474a-8beb-79026b355f82', 'ff4d12ad-73f5-4668-8223-f43b46784882', '2d594ff8-a952-487c-b3ca-e4a147db9f51', '8a15b46a-ed80-4beb-8d15-2f6fbdae1cdf'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:12 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:12 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:12 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Deleted volume successfully. Jul 14 20:21:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-29ee8e27-4159-4adb-bad8-9ddd09ab8c76 tempest-VolumesActionsTest-2077656939 None] Lock "cinder-49e23cf8-d86a-4599-8eed-072f3d0d7beb-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:22 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=87,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=24 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:21:22 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=98,cinder:UPDATE=102,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:21:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dd702b08-80f4-4d92-b649-7c35fc808a4c tempest-GroupsV320Test-1528946017 None] Group tempest-GroupsV320Test-Group-1874828276: creating Jul 14 20:21:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dd702b08-80f4-4d92-b649-7c35fc808a4c tempest-GroupsV320Test-1528946017 None] Group tempest-GroupsV320Test-Group-1874828276: created successfully Jul 14 20:21:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dd702b08-80f4-4d92-b649-7c35fc808a4c tempest-GroupsV320Test-1528946017 None] Create group completed successfully. Jul 14 20:21:25 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Created reservations ['0b6092e3-1b53-451a-a792-3ebfa1e97a49'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:26 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:26 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:26 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.344s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:26 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b47d9235-7d95-4e2a-829c-0bce2343200b tempest-GroupsV320Test-1528946017 None] Delete group completed successfully. Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Flow 'volume_create_manager' (35fde4a2-d74c-4dc3-a80f-9e46ec13fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4816f1-f1ba-4b5b-8852-34b008406054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4816f1-f1ba-4b5b-8852-34b008406054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1912257363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f66184-f4c5-4bfa-9a58-88333e048177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff35d24f0344d08b95cac2e549cfd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:31Z,use_quota=True,user_id='45cb350c1e93440eabfb9b4f658ba601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb180d0-0908-4bb2-a02f-d0fe615aa49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb180d0-0908-4bb2-a02f-d0fe615aa49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0e3ee1-b0fc-4db6-a513-a60d3d803c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:31 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0e3ee1-b0fc-4db6-a513-a60d3d803c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0f66184-f4c5-4bfa-9a58-88333e048177', 'volume_name': 'volume-d0f66184-f4c5-4bfa-9a58-88333e048177', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fba951-3ec9-443a-9b1d-f346acbde2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fba951-3ec9-443a-9b1d-f346acbde2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16550437-cca7-4f33-834b-c180d0056baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Volume d0f66184-f4c5-4bfa-9a58-88333e048177: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0f66184-f4c5-4bfa-9a58-88333e048177', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Trying to clone d0f66184-f4c5-4bfa-9a58-88333e048177 from image a28aaf9a-7579-4123-bee1-aab6e137d44e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:21:32 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Image download 20.69 MB at 20.69 MB/s Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd9b010-2099-4c83-8fc1-4b5ac6c0a7a2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:32 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD Jul 14 20:21:32 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:33 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e is fetched for user 45cb350c1e93440eabfb9b4f658ba601. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737db45-4a17-4f7f-ad45-09f1be9c67c7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:33 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD Jul 14 20:21:33 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:33 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1912257363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f66184-f4c5-4bfa-9a58-88333e048177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff35d24f0344d08b95cac2e549cfd01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:31Z,use_quota=True,user_id='45cb350c1e93440eabfb9b4f658ba601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Creating volume d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:33 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:33 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1073741824 Jul 14 20:21:33 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:34 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1073741824" returned: 0 in 0.654s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:34 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:34 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (059d4cd3-64a0-4685-8cfd-e85f74130936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3602e8-3e2e-41d6-9b9a-bc06ca7c7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3602e8-3e2e-41d6-9b9a-bc06ca7c7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-113874831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b5b61e-59eb-43d5-bd61-9b0a00beae93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:34Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f09b4f0-8ec9-4ef0-bda3-0af2e1a5dba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f09b4f0-8ec9-4ef0-bda3-0af2e1a5dba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aba48e0-7e52-4527-9f89-3a80d194dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aba48e0-7e52-4527-9f89-3a80d194dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b5b61e-59eb-43d5-bd61-9b0a00beae93', 'volume_name': 'volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79b51d7-978c-4140-a1a6-159dfb208cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79b51d7-978c-4140-a1a6-159dfb208cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3662dfda-e34b-486a-a5ab-2097c8c6756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:34 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Volume 37b5b61e-59eb-43d5-bd61-9b0a00beae93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93', 'volume_size': 1} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:34 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 0 in 0.249s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-113874831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b5b61e-59eb-43d5-bd61-9b0a00beae93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:34Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Creating volume 37b5b61e-59eb-43d5-bd61-9b0a00beae93 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:34 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:34 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 1073741824 Jul 14 20:21:34 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Attempting download of a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume d0f66184-f4c5-4bfa-9a58-88333e048177. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4adf7f-e0a3-47d6-9f3d-07b88f944f09]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:34 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i Jul 14 20:21:34 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:34 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i" returned: 0 in 0.376s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:34 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 1073741824" returned: 0 in 0.520s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:35 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 Jul 14 20:21:35 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:35 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i Jul 14 20:21:35 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:35 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93" returned: 0 in 0.306s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3662dfda-e34b-486a-a5ab-2097c8c6756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9787293c-fe56-4de6-b313-9c51127bea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:35 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Volume volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 (37b5b61e-59eb-43d5-bd61-9b0a00beae93): created successfully Jul 14 20:21:35 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9787293c-fe56-4de6-b313-9c51127bea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (059d4cd3-64a0-4685-8cfd-e85f74130936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i" returned: 1 in 0.427s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9l10hm0i' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e783fd0a-26db-4c71-b37f-216e3b33d5e4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1360d8ac-b048-4f8b-b15f-76ccafe1bc20 tempest-AttachVolumeNegativeTest-31222840 None] Created volume successfully. Jul 14 20:21:35 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD Jul 14 20:21:35 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:35 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] a28aaf9a-7579-4123-bee1-aab6e137d44e was qcow2, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:21:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:35 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:35 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec4b212-a0d3-4d27-8b5a-bcfd303d3b4a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:37 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 Jul 14 20:21:37 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:37 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 0 in 1.615s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_i7nd140ydevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:21:37 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Converted 112.00 MB image at 69.27 MB/s Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:37 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1G Jul 14 20:21:37 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:37 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.372s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4f9b104-ef7d-45cc-909a-bf5d75828266', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:21:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-e93df4ce-6c0e-45fc-b2b2-0b5c1ab70845 req-28dd70ed-d3b7-4c25-bfc5-567cdefc7b66 tempest-AttachVolumeNegativeTest-31222840 None] attachment_update completed successfully. Jul 14 20:21:37 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 1G" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cc63e2-e3f3-4e15-aa88-16995bf344a0]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:37 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:37 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:38 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 0 in 0.430s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:38 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:38 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:38 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 1 in 0.404s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Downloaded image a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume d0f66184-f4c5-4bfa-9a58-88333e048177 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e for user 45cb350c1e93440eabfb9b4f658ba601 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Marking volume d0f66184-f4c5-4bfa-9a58-88333e048177 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Copying metadata from image a28aaf9a-7579-4123-bee1-aab6e137d44e to d0f66184-f4c5-4bfa-9a58-88333e048177. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Creating volume glance metadata for volume d0f66184-f4c5-4bfa-9a58-88333e048177 backed by image a28aaf9a-7579-4123-bee1-aab6e137d44e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16550437-cca7-4f33-834b-c180d0056baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f66184-f4c5-4bfa-9a58-88333e048177', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f7af34-c150-4978-a2d6-528509004af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:38 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Volume volume-d0f66184-f4c5-4bfa-9a58-88333e048177 (d0f66184-f4c5-4bfa-9a58-88333e048177): created successfully Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f7af34-c150-4978-a2d6-528509004af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Flow 'volume_create_manager' (35fde4a2-d74c-4dc3-a80f-9e46ec13fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4f5b71a6-8e29-43f7-82ab-563a201f2345 tempest-VolumesImageMetadata-1981062443 None] Created volume successfully. Jul 14 20:21:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-7d5328c0-7b5b-4a80-9d3e-effa55d33f3a req-38168575-8ffe-49cd-9b3e-549a9ba2e196 tempest-AttachVolumeNegativeTest-31222840 None] Terminate volume connection completed successfully. Jul 14 20:21:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-7d5328c0-7b5b-4a80-9d3e-effa55d33f3a req-38168575-8ffe-49cd-9b3e-549a9ba2e196 tempest-AttachVolumeNegativeTest-31222840 None] Deleting attachment d4f9b104-ef7d-45cc-909a-bf5d75828266. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Acquiring lock "cinder-d0f66184-f4c5-4bfa-9a58-88333e048177-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "cinder-d0f66184-f4c5-4bfa-9a58-88333e048177-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Acquiring lock "cinder-quobyte-d0f66184-f4c5-4bfa-9a58-88333e048177" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "cinder-quobyte-d0f66184-f4c5-4bfa-9a58-88333e048177" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e02f1-e7f5-40bf-aa7a-bffb21bccb69]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:40 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:40 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:40 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:40 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:40 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:41 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 1 in 0.726s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:21:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:41 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177 Jul 14 20:21:41 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:41 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d0f66184-f4c5-4bfa-9a58-88333e048177" returned: 0 in 0.499s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "cinder-quobyte-d0f66184-f4c5-4bfa-9a58-88333e048177" released by "delete_volume" :: held 1.710s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Created reservations ['9e4373e3-1923-40bd-9354-70c8f406ecab', '8b61e92c-a8d2-4f38-baea-74b6cb46591c', 'eda211f7-4c70-43a1-855c-2426140cab99', '15b735ed-8785-4fd7-b1e1-2ac396a7248e'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:42 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:42 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:42 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.320s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Deleted volume successfully. Jul 14 20:21:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7f3d0c5a-91f6-41c1-ab2d-2e7905a338e7 tempest-VolumesImageMetadata-1981062443 None] Lock "cinder-d0f66184-f4c5-4bfa-9a58-88333e048177-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (65558c80-e0fc-48c0-9046-57935885e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e876d11f-2834-459a-861e-1c8bb71f2921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e876d11f-2834-459a-861e-1c8bb71f2921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1269762100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4a4937-8f09-4282-add5-be54f1237a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:47Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2b4ba0-3f35-4326-886a-4656cd6ea51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2b4ba0-3f35-4326-886a-4656cd6ea51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd979c37-c686-4581-9931-f433c39f23ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd979c37-c686-4581-9931-f433c39f23ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4a4937-8f09-4282-add5-be54f1237a15', 'volume_name': 'volume-fb4a4937-8f09-4282-add5-be54f1237a15', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83902976-bcc1-4522-b3dd-5a751c53f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83902976-bcc1-4522-b3dd-5a751c53f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc1d62-2aa4-4548-a909-5c2faabd1d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Volume fb4a4937-8f09-4282-add5-be54f1237a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4a4937-8f09-4282-add5-be54f1237a15', 'volume_size': 1} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1269762100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4a4937-8f09-4282-add5-be54f1237a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:47Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Creating volume fb4a4937-8f09-4282-add5-be54f1237a15 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:46 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:46 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 1073741824 Jul 14 20:21:46 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:47 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 1073741824" returned: 0 in 0.543s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:47 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 Jul 14 20:21:47 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:47 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15" returned: 0 in 0.328s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc1d62-2aa4-4548-a909-5c2faabd1d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4a4937-8f09-4282-add5-be54f1237a15', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd469b-60fa-4d39-9dad-a0c9068f3c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:47 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Volume volume-fb4a4937-8f09-4282-add5-be54f1237a15 (fb4a4937-8f09-4282-add5-be54f1237a15): created successfully Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd469b-60fa-4d39-9dad-a0c9068f3c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (65558c80-e0fc-48c0-9046-57935885e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:47 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7f5e5cb7-a1a3-4c69-ae5e-5fdea1e533e6 tempest-AttachVolumeTestJSON-877122130 None] Created volume successfully. Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Flow 'volume_create_manager' (2c6fc8b5-deb7-4d26-ba3c-ddd877fca73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3466e97-4926-4916-89b2-9dfd86f04352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3466e97-4926-4916-89b2-9dfd86f04352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1849667482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d550c656-9cad-4b66-b136-764d55b92d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c249cbc302541b9995d50ff4a7729a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:48Z,use_quota=True,user_id='4a912b80caae4651b12dde9d555b983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbc1853-92e7-41e6-80d6-68fb757ad905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbc1853-92e7-41e6-80d6-68fb757ad905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadc0233-3655-4a88-89de-3ed3f8bbe992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eadc0233-3655-4a88-89de-3ed3f8bbe992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd550c656-9cad-4b66-b136-764d55b92d62', 'volume_name': 'volume-d550c656-9cad-4b66-b136-764d55b92d62', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71b46e5-1e81-49ca-8c25-81dce35b381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71b46e5-1e81-49ca-8c25-81dce35b381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5c0ab1-4b4c-4fd3-8d58-c845cbd7d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Volume d550c656-9cad-4b66-b136-764d55b92d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d550c656-9cad-4b66-b136-764d55b92d62', 'volume_size': 1} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1849667482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d550c656-9cad-4b66-b136-764d55b92d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c249cbc302541b9995d50ff4a7729a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:48Z,use_quota=True,user_id='4a912b80caae4651b12dde9d555b983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Creating volume d550c656-9cad-4b66-b136-764d55b92d62 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:48 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:48 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 1073741824 Jul 14 20:21:48 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:48 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 1073741824" returned: 0 in 0.450s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:48 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 Jul 14 20:21:48 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:48 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5c0ab1-4b4c-4fd3-8d58-c845cbd7d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d550c656-9cad-4b66-b136-764d55b92d62', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b772961-a18b-4021-a0ab-85e087ec289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Volume volume-d550c656-9cad-4b66-b136-764d55b92d62 (d550c656-9cad-4b66-b136-764d55b92d62): created successfully Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b772961-a18b-4021-a0ab-85e087ec289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Flow 'volume_create_manager' (2c6fc8b5-deb7-4d26-ba3c-ddd877fca73b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cee9d459-597e-49f1-8703-89b5aadaf985 tempest-AbsoluteLimitsTests-1602197624 None] Created volume successfully. Jul 14 20:21:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475c471-5069-45d1-896d-49d3e565cd2e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:49 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 Jul 14 20:21:49 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:50 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.546s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-fb4a4937-8f09-4282-add5-be54f1237a15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bdf0f3b-b1a2-4183-ad52-bb7aca551b54', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:21:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-76e60485-68f1-4d90-8add-39ac38773914 req-9ff1ff39-4203-4796-8b33-1490b1404015 tempest-AttachVolumeTestJSON-877122130 None] attachment_update completed successfully. Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Flow 'volume_create_manager' (9c61ce66-c311-4e7e-bfcf-92b090b6897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71d5bc0-f84f-44a1-a43a-a4a9b762e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71d5bc0-f84f-44a1-a43a-a4a9b762e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-521111494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f2646-2d4e-439e-a405-db652503f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a2afdab5514f4eb7db47766199ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:51Z,use_quota=True,user_id='34290d98ea214b1f862ee653dfde374d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10feefb-0ae0-4b71-875f-7bacdee3abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10feefb-0ae0-4b71-875f-7bacdee3abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cba527e-c3c4-4116-aa11-76f3093d48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cba527e-c3c4-4116-aa11-76f3093d48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051f2646-2d4e-439e-a405-db652503f7d6', 'volume_name': 'volume-051f2646-2d4e-439e-a405-db652503f7d6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e1876f-aa5c-4de8-9ab3-afc63bd054af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e1876f-aa5c-4de8-9ab3-afc63bd054af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a2aa1c-e320-411a-a11c-0015a9fb8437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Volume 051f2646-2d4e-439e-a405-db652503f7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051f2646-2d4e-439e-a405-db652503f7d6', 'volume_size': 1} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-521111494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f2646-2d4e-439e-a405-db652503f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a2afdab5514f4eb7db47766199ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:51Z,use_quota=True,user_id='34290d98ea214b1f862ee653dfde374d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Creating volume 051f2646-2d4e-439e-a405-db652503f7d6 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:50 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Acquiring lock "cinder-d550c656-9cad-4b66-b136-764d55b92d62-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:50 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 1073741824 Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "cinder-d550c656-9cad-4b66-b136-764d55b92d62-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:50 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Acquiring lock "cinder-quobyte-d550c656-9cad-4b66-b136-764d55b92d62" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "cinder-quobyte-d550c656-9cad-4b66-b136-764d55b92d62" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff7225-5179-4020-8478-11cb0c22ec0b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:51 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 Jul 14 20:21:51 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:51 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62" returned: 0 in 0.441s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:51 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 1073741824" returned: 0 in 0.691s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:51 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62 Jul 14 20:21:51 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:51 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 Jul 14 20:21:51 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:51 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d550c656-9cad-4b66-b136-764d55b92d62" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "cinder-quobyte-d550c656-9cad-4b66-b136-764d55b92d62" released by "delete_volume" :: held 0.888s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Created reservations ['52bb7a32-b99f-4cb2-a42f-6e3cfe65145b', '59489509-72d2-4dcd-b0b9-a6ce62f4a620', 'ff535754-e988-4c87-9750-3c9405ce0246', '53cf6324-0244-41da-863e-7b399f2ca6a2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:51 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6" returned: 0 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a2aa1c-e320-411a-a11c-0015a9fb8437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051f2646-2d4e-439e-a405-db652503f7d6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90a8dc8-b5c8-4e6f-b072-e50a26e7ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Volume volume-051f2646-2d4e-439e-a405-db652503f7d6 (051f2646-2d4e-439e-a405-db652503f7d6): created successfully Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90a8dc8-b5c8-4e6f-b072-e50a26e7ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Flow 'volume_create_manager' (9c61ce66-c311-4e7e-bfcf-92b090b6897d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f097fe8e-24d7-4a21-9d47-e408dd0f5e2b tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Created volume successfully. Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:52 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:52 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:52 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.391s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Deleted volume successfully. Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5dff9d18-856b-4255-9c3d-73257d3699d4 tempest-AbsoluteLimitsTests-1602197624 None] Lock "cinder-d550c656-9cad-4b66-b136-764d55b92d62-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (c5a24e7c-8544-42d0-818e-e4562e70323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b42c07-c9d4-465d-96f2-caf614fd5fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b42c07-c9d4-465d-96f2-caf614fd5fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933627025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:53Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afeebf8-81b2-4d46-91bc-de111b382346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afeebf8-81b2-4d46-91bc-de111b382346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8111721c-8471-4c3e-94e9-7ff55cc14471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8111721c-8471-4c3e-94e9-7ff55cc14471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9', 'volume_name': 'volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a222854-9718-441f-8a1c-5b6ad1431f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a222854-9718-441f-8a1c-5b6ad1431f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7517da4e-9f94-4bdc-a728-98395b995234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Volume e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9', 'volume_size': 1} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933627025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baac2215be024e3b865f270cffd972c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:21:53Z,use_quota=True,user_id='6b205cfe6f0c41249b8d1061a45ffab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Creating volume e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:21:52 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:21:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:52 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 1073741824 Jul 14 20:21:52 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:53 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 1073741824" returned: 0 in 0.720s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:53 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 Jul 14 20:21:53 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:54 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7517da4e-9f94-4bdc-a728-98395b995234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b4c4e4-5e8b-4cc9-b24c-5d5b1d5d2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:21:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Volume volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 (e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9): created successfully Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b4c4e4-5e8b-4cc9-b24c-5d5b1d5d2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Flow 'volume_create_manager' (c5a24e7c-8544-42d0-818e-e4562e70323f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:21:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cb33d876-bf8c-41c1-ab5b-665dbca519d0 tempest-AttachVolumeTestJSON-877122130 None] Created volume successfully. Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Acquiring lock "cinder-051f2646-2d4e-439e-a405-db652503f7d6-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "cinder-051f2646-2d4e-439e-a405-db652503f7d6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Acquiring lock "cinder-quobyte-051f2646-2d4e-439e-a405-db652503f7d6" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "cinder-quobyte-051f2646-2d4e-439e-a405-db652503f7d6" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2163ac6-06c9-4d4b-a59b-63277973ef88]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:54 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 Jul 14 20:21:54 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:55 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6" returned: 0 in 0.587s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:55 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6 Jul 14 20:21:55 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:55 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-051f2646-2d4e-439e-a405-db652503f7d6" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "cinder-quobyte-051f2646-2d4e-439e-a405-db652503f7d6" released by "delete_volume" :: held 1.078s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:55 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Created reservations ['40116b4f-8b66-4d82-8f7c-ed5f1870d991', '64f6662c-f44c-418e-a69e-1d625ff273d5', 'a723e867-e1c5-4349-bdde-f32f8f439cb7', '15e73b0f-ae35-45ad-9bc6-560db279e908'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:56 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:21:56 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c0c38-63d4-42cd-88d0-4bd4b3f3171e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:21:56 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 Jul 14 20:21:56 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:21:56 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.525s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:21:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Deleted volume successfully. Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ca0614c-660b-4f9c-8d62-0dbb21c82754 tempest-VolumeQuotasNegativeTestJSON-1011657374 None] Lock "cinder-051f2646-2d4e-439e-a405-db652503f7d6-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:21:56 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" returned: 0 in 0.712s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:21:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e920609f-e02c-4a1a-8d54-cc7a0f35d125', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:21:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-48eeaf27-1756-40f4-94ff-d22d98e19c5b req-1f25df73-7607-4caf-88f7-87ab8f5368ab tempest-AttachVolumeTestJSON-877122130 None] attachment_update completed successfully. Jul 14 20:22:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-bfd3a6a6-5d04-4457-a3d2-c7c7da7d2656 req-99fb3e39-8e80-4418-aa04-a3af752e3d2b tempest-AttachVolumeTestJSON-877122130 None] Terminate volume connection completed successfully. Jul 14 20:22:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-bfd3a6a6-5d04-4457-a3d2-c7c7da7d2656 req-99fb3e39-8e80-4418-aa04-a3af752e3d2b tempest-AttachVolumeTestJSON-877122130 None] Deleting attachment 7bdf0f3b-b1a2-4183-ad52-bb7aca551b54. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:22:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-bea136ae-8506-4023-8118-983dd6af7193 req-73b52e5d-f6f3-4314-901d-66d71c8f1cae tempest-AttachVolumeTestJSON-877122130 None] Terminate volume connection completed successfully. Jul 14 20:22:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-bea136ae-8506-4023-8118-983dd6af7193 req-73b52e5d-f6f3-4314-901d-66d71c8f1cae tempest-AttachVolumeTestJSON-877122130 None] Deleting attachment e920609f-e02c-4a1a-8d54-cc7a0f35d125. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:03 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:03 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:03 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.640s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:22:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Flow 'volume_create_manager' (8391aa8c-af96-4976-995e-1294eff760bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8912800f-504d-4aff-8198-c1e30b2cf7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8912800f-504d-4aff-8198-c1e30b2cf7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-980501684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eab993-0912-4d6d-8856-770f2386ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f17d3b11acd47f0b72d8e5bf91fccdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:05Z,use_quota=True,user_id='6f30f141109a49fa97333568949b82bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6359760d-58af-4e4a-bf3c-e11eaa0e06bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6359760d-58af-4e4a-bf3c-e11eaa0e06bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7d4767-46cc-4221-b134-798366c4abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7d4767-46cc-4221-b134-798366c4abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1eab993-0912-4d6d-8856-770f2386ad09', 'volume_name': 'volume-b1eab993-0912-4d6d-8856-770f2386ad09', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e8d124-8d53-4d4d-a849-c3e81145b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e8d124-8d53-4d4d-a849-c3e81145b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913744db-3b57-4de2-accc-c528392373ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Volume b1eab993-0912-4d6d-8856-770f2386ad09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1eab993-0912-4d6d-8856-770f2386ad09', 'volume_size': 1} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-980501684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eab993-0912-4d6d-8856-770f2386ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f17d3b11acd47f0b72d8e5bf91fccdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:05Z,use_quota=True,user_id='6f30f141109a49fa97333568949b82bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Creating volume b1eab993-0912-4d6d-8856-770f2386ad09 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:04 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:04 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 1073741824 Jul 14 20:22:04 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:05 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 1073741824" returned: 0 in 0.640s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:05 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 Jul 14 20:22:05 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:05 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913744db-3b57-4de2-accc-c528392373ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1eab993-0912-4d6d-8856-770f2386ad09', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90837cd3-c93b-49bb-84ba-edddf6fe084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Volume volume-b1eab993-0912-4d6d-8856-770f2386ad09 (b1eab993-0912-4d6d-8856-770f2386ad09): created successfully Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90837cd3-c93b-49bb-84ba-edddf6fe084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Flow 'volume_create_manager' (8391aa8c-af96-4976-995e-1294eff760bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-aa3c9e2a-4411-49e7-bb6e-c9f8d18352df tempest-VolumesTransfersTest-2097177331 None] Created volume successfully. Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Flow 'volume_create_manager' (4c461168-5069-481a-adba-2cb6d13fd69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd1c2c1-3239-4362-8f09-b88fc9d0ac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd1c2c1-3239-4362-8f09-b88fc9d0ac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-822839413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28afe02d-9b9e-4b6c-b98b-349aa518492a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b097141ca54fe38b91c5ac0448a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:07Z,use_quota=True,user_id='69c033fb6bfa438798be072345770d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c41426-4fe6-420b-9842-2282775f650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c41426-4fe6-420b-9842-2282775f650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3320b9-631a-4407-b629-e01a79d1c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3320b9-631a-4407-b629-e01a79d1c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28afe02d-9b9e-4b6c-b98b-349aa518492a', 'volume_name': 'volume-28afe02d-9b9e-4b6c-b98b-349aa518492a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843c17c4-6907-4a43-8fb5-25822818561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843c17c4-6907-4a43-8fb5-25822818561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4557ae-e1e7-41c8-95e7-d806c473c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Volume 28afe02d-9b9e-4b6c-b98b-349aa518492a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28afe02d-9b9e-4b6c-b98b-349aa518492a', 'volume_size': 1} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-822839413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28afe02d-9b9e-4b6c-b98b-349aa518492a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b097141ca54fe38b91c5ac0448a401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:07Z,use_quota=True,user_id='69c033fb6bfa438798be072345770d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Creating volume 28afe02d-9b9e-4b6c-b98b-349aa518492a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:07 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:07 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a 1073741824 Jul 14 20:22:07 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:07 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a 1073741824" returned: 0 in 0.528s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:07 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a Jul 14 20:22:07 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-59ee6e40-c286-4426-b888-d90449917bcb tempest-VolumesTransfersTest-58710356 None] Transfer volume completed successfully. Jul 14 20:22:08 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a" returned: 0 in 0.445s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4557ae-e1e7-41c8-95e7-d806c473c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28afe02d-9b9e-4b6c-b98b-349aa518492a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8946c28-9265-455b-8540-67f665a047a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Volume volume-28afe02d-9b9e-4b6c-b98b-349aa518492a (28afe02d-9b9e-4b6c-b98b-349aa518492a): created successfully Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8946c28-9265-455b-8540-67f665a047a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Flow 'volume_create_manager' (4c461168-5069-481a-adba-2cb6d13fd69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5e776a3f-2074-43a3-94c5-224bebfcb642 tempest-VolumesServicesTestJSON-1565941079 None] Created volume successfully. Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-quobyte-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2a9e3-a8e6-4b20-98f8-edbfb80c9290]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:08 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 Jul 14 20:22:08 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "cinder-b1eab993-0912-4d6d-8856-770f2386ad09-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-b1eab993-0912-4d6d-8856-770f2386ad09-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "cinder-quobyte-b1eab993-0912-4d6d-8856-770f2386ad09" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-quobyte-b1eab993-0912-4d6d-8856-770f2386ad09" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b725f7-62dc-44b2-a4a7-738d44ba2871]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:08 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" returned: 0 in 0.426s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:08 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9 Jul 14 20:22:08 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:08 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 Jul 14 20:22:08 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:09 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Acquiring lock "cinder-28afe02d-9b9e-4b6c-b98b-349aa518492a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9" released by "delete_volume" :: held 0.795s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "cinder-28afe02d-9b9e-4b6c-b98b-349aa518492a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:09 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:09 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09 Jul 14 20:22:09 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Acquiring lock "cinder-quobyte-28afe02d-9b9e-4b6c-b98b-349aa518492a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "cinder-quobyte-28afe02d-9b9e-4b6c-b98b-349aa518492a" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Created reservations ['6fcf04e6-0fae-4ffe-aa94-a1171ed747bb', 'ccace751-cf82-4f33-8ad3-4ac40bcb2fd1', 'bcbd019f-42ec-4311-910e-9f94c9d14bd9', '4ecc60c6-5ec8-46ff-8f99-38cc3c89148e'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c008cf3a-63a6-4ed3-bff1-c39aecbdf58c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:09 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a Jul 14 20:22:09 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:09 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:09 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-fb4a4937-8f09-4282-add5-be54f1237a15-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:09 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b1eab993-0912-4d6d-8856-770f2386ad09" returned: 0 in 0.371s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-fb4a4937-8f09-4282-add5-be54f1237a15-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-quobyte-b1eab993-0912-4d6d-8856-770f2386ad09" released by "delete_volume" :: held 0.897s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-quobyte-fb4a4937-8f09-4282-add5-be54f1237a15" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-fb4a4937-8f09-4282-add5-be54f1237a15" acquired by "delete_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[00645194-6d23-48a7-94f9-906d8224f281]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Created reservations ['06968e26-8185-4a88-a4e7-aa1f97dc7ecb', '97034afe-835f-45af-90ef-20e48fd6552f', '380b97dd-21e0-46f6-b424-ea968d1b6c42', '415b71e5-ae79-4d32-9644-567a1d05747d'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:10 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Deleted volume successfully. Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:10 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 Jul 14 20:22:10 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a" returned: 0 in 0.661s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:10 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:10 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16a5af91-b8d7-4e5d-828b-1e205cd9a7f1 tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-e868fcf5-d6a6-44fa-9fe1-0f77b9e723e9-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:10 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a Jul 14 20:22:10 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.287s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15" returned: 0 in 0.493s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:10 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-28afe02d-9b9e-4b6c-b98b-349aa518492a" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Deleted volume successfully. Jul 14 20:22:10 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15 Jul 14 20:22:10 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "cinder-quobyte-28afe02d-9b9e-4b6c-b98b-349aa518492a" released by "delete_volume" :: held 0.991s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bd96e1df-4e56-4e04-b070-6ff81afeb54b tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-b1eab993-0912-4d6d-8856-770f2386ad09-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Created reservations ['c76e8e9e-8a44-44c1-b316-074e0f09c680', 'd5716c0c-4215-4203-b625-4d66e6906e9e', '1254793a-4c74-4671-8bec-4b61f12277d0', '553fec15-5f77-494f-aa9f-90164b85adb4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:10 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:10 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fb4a4937-8f09-4282-add5-be54f1237a15" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-fb4a4937-8f09-4282-add5-be54f1237a15" released by "delete_volume" :: held 0.809s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Created reservations ['d73fdfa3-6c64-4997-80f9-72425cc0067c', '6f10e2ee-d55f-4834-85b0-ee5d3d9c8e32', 'fa767c50-3057-4d0e-818e-da0cc8f2c41b', '92074883-3ca0-4e3a-a935-a27dbc71b3b6'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:10 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:10 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:10 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.304s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Deleted volume successfully. Jul 14 20:22:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-041d3fbb-f44b-4aa4-962c-ec90f13decc8 tempest-VolumesServicesTestJSON-1565941079 None] Lock "cinder-28afe02d-9b9e-4b6c-b98b-349aa518492a-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-e53bb63f-19b8-4e75-93e2-11e04bfcc657-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-e53bb63f-19b8-4e75-93e2-11e04bfcc657-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:11 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.326s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Deleted volume successfully. Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "cinder-quobyte-e53bb63f-19b8-4e75-93e2-11e04bfcc657" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1cbfc4b9-1224-4a84-a621-64e8bd54f09c tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-fb4a4937-8f09-4282-add5-be54f1237a15-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-e53bb63f-19b8-4e75-93e2-11e04bfcc657" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e5bab-0e8a-4f94-81a2-1a69852b37c4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:11 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 Jul 14 20:22:11 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:11 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657" returned: 0 in 0.446s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:11 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657 Jul 14 20:22:11 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Flow 'volume_create_manager' (8ef5553d-8ad1-481d-aa97-3c6966d6bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc995a0-8473-49ca-983c-cf96f188ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc995a0-8473-49ca-983c-cf96f188ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679970103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4113f7-9c65-451d-b357-a108fd53b5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f17d3b11acd47f0b72d8e5bf91fccdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:12Z,use_quota=True,user_id='6f30f141109a49fa97333568949b82bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e7c534-908a-4130-89f2-1fc874ae3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e7c534-908a-4130-89f2-1fc874ae3740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82824c8a-8a2c-455e-8011-39571679c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82824c8a-8a2c-455e-8011-39571679c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4113f7-9c65-451d-b357-a108fd53b5eb', 'volume_name': 'volume-8f4113f7-9c65-451d-b357-a108fd53b5eb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994037f7-cde9-41d6-94d7-c249af1b86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994037f7-cde9-41d6-94d7-c249af1b86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab19ae7-c72f-4a81-bf7e-4aece9d055ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:11 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Volume 8f4113f7-9c65-451d-b357-a108fd53b5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4113f7-9c65-451d-b357-a108fd53b5eb', 'volume_size': 1} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679970103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4113f7-9c65-451d-b357-a108fd53b5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f17d3b11acd47f0b72d8e5bf91fccdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:12Z,use_quota=True,user_id='6f30f141109a49fa97333568949b82bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Creating volume 8f4113f7-9c65-451d-b357-a108fd53b5eb {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:11 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:11 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb 1073741824 Jul 14 20:22:11 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:11 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e53bb63f-19b8-4e75-93e2-11e04bfcc657" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-quobyte-e53bb63f-19b8-4e75-93e2-11e04bfcc657" released by "delete_volume" :: held 0.769s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:11 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Created reservations ['8aea22c4-e571-47d0-94ae-411fae3bc0b1', '93a52844-ca6c-4b2d-bd2b-b9db923e3bb3', '5ec8a719-aae1-4057-b6d8-57ee4d14d430', 'a15b1e69-e4b2-4c88-a445-cab4a152f1a6'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:12 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:12 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:12 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb 1073741824" returned: 0 in 0.564s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:12 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.312s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Deleted volume successfully. Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:12 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb Jul 14 20:22:12 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1ec74be7-e848-46f2-875b-c9bf0e51422d tempest-AttachVolumeTestJSON-877122130 None] Lock "cinder-e53bb63f-19b8-4e75-93e2-11e04bfcc657-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:12 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab19ae7-c72f-4a81-bf7e-4aece9d055ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4113f7-9c65-451d-b357-a108fd53b5eb', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0cd892-af63-4000-975e-8847b71c3f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:12 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Volume volume-8f4113f7-9c65-451d-b357-a108fd53b5eb (8f4113f7-9c65-451d-b357-a108fd53b5eb): created successfully Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0cd892-af63-4000-975e-8847b71c3f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Flow 'volume_create_manager' (8ef5553d-8ad1-481d-aa97-3c6966d6bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d917ea3c-8174-447e-b9eb-2a0b50ce6f17 tempest-VolumesTransfersTest-2097177331 None] Created volume successfully. Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "cinder-8f4113f7-9c65-451d-b357-a108fd53b5eb-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-8f4113f7-9c65-451d-b357-a108fd53b5eb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "cinder-quobyte-8f4113f7-9c65-451d-b357-a108fd53b5eb" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-quobyte-8f4113f7-9c65-451d-b357-a108fd53b5eb" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c5a6c-2118-4fde-9a2b-224d44e95617]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:14 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb Jul 14 20:22:14 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:14 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb" returned: 0 in 0.461s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:14 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb Jul 14 20:22:14 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:14 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8f4113f7-9c65-451d-b357-a108fd53b5eb" returned: 0 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-quobyte-8f4113f7-9c65-451d-b357-a108fd53b5eb" released by "delete_volume" :: held 0.844s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Created reservations ['4abee893-d08a-460d-8c32-55d2ca5c0782', '6b2ab3cf-8df5-4c6e-a236-13b4f960fef0', '626cff2b-2e43-46b1-bc00-8e3c151c502f', '8bd9658d-0ff3-4b16-97da-8a064d80ebd3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:15 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:15 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:15 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Deleted volume successfully. Jul 14 20:22:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-15f94482-26ed-439b-9521-7406fb51acfe tempest-VolumesTransfersTest-1292556211 None] Lock "cinder-8f4113f7-9c65-451d-b357-a108fd53b5eb-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (feac7b1d-8f5a-49f7-a69e-3606a2102316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea7b63-8fa3-4a37-bf9e-16e8c6cd32cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea7b63-8fa3-4a37-bf9e-16e8c6cd32cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928258283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b434ef6-8482-4758-bd90-a251867a064e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:21Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023c74-58e1-42d1-9e46-9afef13b4b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023c74-58e1-42d1-9e46-9afef13b4b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13082f23-403f-411f-9241-414665c6777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13082f23-403f-411f-9241-414665c6777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b434ef6-8482-4758-bd90-a251867a064e', 'volume_name': 'volume-6b434ef6-8482-4758-bd90-a251867a064e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8805cfc6-fabf-4bee-947e-4f5954245401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8805cfc6-fabf-4bee-947e-4f5954245401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1fef76-62cf-45a6-a861-e68fa598d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Volume 6b434ef6-8482-4758-bd90-a251867a064e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b434ef6-8482-4758-bd90-a251867a064e', 'volume_size': 1} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928258283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b434ef6-8482-4758-bd90-a251867a064e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03962500d59243c2b060257e6835b337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:21Z,use_quota=True,user_id='d72757534c534defaf5a31b41c3ad721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Creating volume 6b434ef6-8482-4758-bd90-a251867a064e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:21 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:21 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e 1073741824 Jul 14 20:22:21 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:22 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e 1073741824" returned: 0 in 0.575s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:22 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e Jul 14 20:22:22 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:22 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1fef76-62cf-45a6-a861-e68fa598d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b434ef6-8482-4758-bd90-a251867a064e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22663f2-1674-4aae-8a47-897bffad71f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Volume volume-6b434ef6-8482-4758-bd90-a251867a064e (6b434ef6-8482-4758-bd90-a251867a064e): created successfully Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22663f2-1674-4aae-8a47-897bffad71f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Flow 'volume_create_manager' (feac7b1d-8f5a-49f7-a69e-3606a2102316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ca02f407-43b5-4e20-bef9-1e862677b5ec tempest-AttachVolumeNegativeTest-31222840 None] Created volume successfully. Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=95,cinder:UPDATE=120,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=104,cinder:UPDATE=104,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Flow 'volume_create_manager' (07563795-2638-4ad6-bc35-84c4e2267513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43791a1-e5e5-4fee-aec8-36bde55abaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43791a1-e5e5-4fee-aec8-36bde55abaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333664239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7845528b8414cccb58f53610d70b93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:23Z,use_quota=True,user_id='c20539b0a0d447fbaa56c358dde1e20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddbeb8a-0548-4417-9416-f2d4281e09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddbeb8a-0548-4417-9416-f2d4281e09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c531ab2-764e-4490-bb90-eaf01ea259e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c531ab2-764e-4490-bb90-eaf01ea259e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937', 'volume_name': 'volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937', 'volume_size': 2}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7c328f-1b60-40eb-9980-eb1e34218a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7c328f-1b60-40eb-9980-eb1e34218a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8164a5e-fb7c-4fc0-80d9-d33892c544ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Volume de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937', 'volume_size': 2} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1333664239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7845528b8414cccb58f53610d70b93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:23Z,use_quota=True,user_id='c20539b0a0d447fbaa56c358dde1e20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Creating volume de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:23 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 2147483648 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:23 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 2147483648 Jul 14 20:22:23 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:23 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 2147483648" returned: 0 in 0.734s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:24 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 Jul 14 20:22:24 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:24 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" returned: 0 in 0.371s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8164a5e-fb7c-4fc0-80d9-d33892c544ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937', 'volume_size': 2}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a65fc-0251-45bb-b413-056838f9973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Volume volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 (de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937): created successfully Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a65fc-0251-45bb-b413-056838f9973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Flow 'volume_create_manager' (07563795-2638-4ad6-bc35-84c4e2267513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-913e9963-c8af-4dde-bf65-6ca453db2812 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Created volume successfully. Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4d09d5-15d5-4059-9e84-ed01a72055ff]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Flow 'volume_create_manager' (208e30dd-d351-480a-aa0e-eaf2b30caada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60aaff55-aa01-42f7-a9ac-56e5aeff7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e Jul 14 20:22:24 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60aaff55-aa01-42f7-a9ac-56e5aeff7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1480626147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a27794981794c44be6b0c44927deaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:25Z,use_quota=True,user_id='d98e63cfee614ce8b5383d5ca729f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a7655c-5679-467e-9a5a-c476d9dfb921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a7655c-5679-467e-9a5a-c476d9dfb921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0296c8a9-5b27-45d1-8a41-adaf5cfb87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0296c8a9-5b27-45d1-8a41-adaf5cfb87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9', 'volume_name': 'volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a08f23-975b-4d64-a061-60abe61de959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a08f23-975b-4d64-a061-60abe61de959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d0aebd-72e3-4199-adc9-83302b26f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Volume 1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9', 'volume_size': 1} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:24 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.410s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1480626147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a27794981794c44be6b0c44927deaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:25Z,use_quota=True,user_id='d98e63cfee614ce8b5383d5ca729f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Creating volume 1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:24 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 1073741824 Jul 14 20:22:24 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-6b434ef6-8482-4758-bd90-a251867a064e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a04003dd-722a-4388-b598-475cfc331112', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:22:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-8e06a13a-6360-4ec8-90b3-f31a941c80a3 req-32ce3667-c51b-455f-8886-d6c493aeffa4 tempest-AttachVolumeNegativeTest-31222840 None] attachment_update completed successfully. Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c39cfe77-acec-4be2-adae-58262e07bfdf tempest-BackendsCapabilitiesAdminTestsJSON-1188717482 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87600) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bc38faed-9132-4044-94aa-6cd3144b68bd tempest-BackendsCapabilitiesAdminTestsJSON-1188717482 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87600) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 20:22:25 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 1073741824" returned: 0 in 0.673s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:25 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 Jul 14 20:22:25 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:25 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" returned: 0 in 0.292s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.306s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Creating offline snapshot ed3b4af3-7da6-4c9c-9fa3-254936b91992 of volume de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d0aebd-72e3-4199-adc9-83302b26f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f142702a-960d-4584-87c9-23148440460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e8975-0cb7-4b1d-8c11-a66eea6e2b86]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Volume volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 (1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9): created successfully Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f142702a-960d-4584-87c9-23148440460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Flow 'volume_create_manager' (208e30dd-d351-480a-aa0e-eaf2b30caada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9829fd5f-b824-4cf4-ad07-b23c8a597d2b tempest-VolumesTransfersV357Test-1275527269 None] Created volume successfully. Jul 14 20:22:26 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 Jul 14 20:22:26 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:26 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" returned: 0 in 0.421s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 2G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:26 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 2G Jul 14 20:22:26 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:26 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 2G" returned: 0 in 0.577s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:26 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 Jul 14 20:22:26 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-774b8cc2-de07-44d0-9db4-9f0962b05ba8 req-9a3fa9c0-e90c-4fcc-9188-bb2a6f6863de tempest-AttachVolumeNegativeTest-31222840 None] Terminate volume connection completed successfully. Jul 14 20:22:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-774b8cc2-de07-44d0-9db4-9f0962b05ba8 req-9a3fa9c0-e90c-4fcc-9188-bb2a6f6863de tempest-AttachVolumeNegativeTest-31222840 None] Deleting attachment a04003dd-722a-4388-b598-475cfc331112. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:22:27 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992" returned: 0 in 0.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:27 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 is being set with open permissions: ugo+rw Jul 14 20:22:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:27 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 Jul 14 20:22:27 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7bab327d-0ea4-4c5e-a2ff-78e44280b114 tempest-VolumesTransfersV357Test-126449365 None] Transfer volume completed successfully. Jul 14 20:22:27 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:27 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info Jul 14 20:22:27 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:28 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info" returned: 0 in 0.442s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:28 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info is being set with open permissions: ugo+rw Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:28 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info Jul 14 20:22:28 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:28 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.info" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "cinder-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ec9da8f1-c40e-406f-9a1c-dc434a5ab8c2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Create snapshot completed successfully Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "cinder-quobyte-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-quobyte-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5438118-18c6-4bb3-a789-efed4325f1a6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:29 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 Jul 14 20:22:29 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:29 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:29 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9 Jul 14 20:22:29 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:29 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-quobyte-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9" released by "delete_volume" :: held 0.782s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Created reservations ['f85be93c-d999-45e1-a0c0-f9621e53d2e4', 'e319cf1a-3a0c-48ec-819d-f1744bfa36af', '4308a03d-c0c6-42b3-a47e-aced6273de61', '09d7f1a3-c676-4cb3-8768-d7efaf563ff5'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:29 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:29 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "cinder-ed3b4af3-7da6-4c9c-9fa3-254936b91992-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-ed3b4af3-7da6-4c9c-9fa3-254936b91992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "cinder-quobyte-ed3b4af3-7da6-4c9c-9fa3-254936b91992" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-ed3b4af3-7da6-4c9c-9fa3-254936b91992" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Deleting offline snapshot ed3b4af3-7da6-4c9c-9fa3-254936b91992 of volume de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] snapshot_file for this snap is: volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f925aaf-a620-4012-a854-f242e7a79ec0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:30 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Deleted volume successfully. Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5bee948d-c462-452f-8d1b-15a5ba5f1261 tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-1c155ddd-d9d8-4e58-8fe6-f3bbbb16b0d9-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:30 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 Jul 14 20:22:30 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:30 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992" returned: 0 in 0.570s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a587796-fb64-4143-93b5-77a629e2460d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Flow 'volume_create_manager' (83b8fe11-e81a-4ed7-af26-92bbe9a95c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f0e7a-d6f3-4904-adf4-eb0b3bc7728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f0e7a-d6f3-4904-adf4-eb0b3bc7728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-613702371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4546fd-3ae6-4805-bb04-46c62101a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a27794981794c44be6b0c44927deaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:31Z,use_quota=True,user_id='d98e63cfee614ce8b5383d5ca729f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46532f9-b972-44a0-bbed-2651fd0a711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46532f9-b972-44a0-bbed-2651fd0a711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67f2c42-23e0-4297-b3af-9e164a2ffb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:31 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 Jul 14 20:22:31 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67f2c42-23e0-4297-b3af-9e164a2ffb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4546fd-3ae6-4805-bb04-46c62101a3cc', 'volume_name': 'volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1f29bc-8700-4e79-abcc-c0a047839d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1f29bc-8700-4e79-abcc-c0a047839d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93989cf8-c950-458f-ab72-09cff3cf26a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:31 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Volume eb4546fd-3ae6-4805-bb04-46c62101a3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc', 'volume_size': 1} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-613702371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4546fd-3ae6-4805-bb04-46c62101a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a27794981794c44be6b0c44927deaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:31Z,use_quota=True,user_id='d98e63cfee614ce8b5383d5ca729f712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Creating volume eb4546fd-3ae6-4805-bb04-46c62101a3cc {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:31 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:31 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc 1073741824 Jul 14 20:22:31 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:31 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:31 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 Jul 14 20:22:31 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:31 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc 1073741824" returned: 0 in 0.519s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:31 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc Jul 14 20:22:31 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:31 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992" returned: 0 in 0.404s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:31 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992 Jul 14 20:22:31 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:31 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc" returned: 0 in 0.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93989cf8-c950-458f-ab72-09cff3cf26a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7c89f2-f1c4-43fa-b60a-d6b0e10f356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Volume volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc (eb4546fd-3ae6-4805-bb04-46c62101a3cc): created successfully Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7c89f2-f1c4-43fa-b60a-d6b0e10f356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Flow 'volume_create_manager' (83b8fe11-e81a-4ed7-af26-92bbe9a95c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:32 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6abe3950-4a35-453a-a3db-b6e0276716c8 tempest-VolumesTransfersV357Test-1275527269 None] Created volume successfully. Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937.ed3b4af3-7da6-4c9c-9fa3-254936b91992" returned: 0 in 0.319s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0e9d7ff9-6037-4306-b1fc-af8974cebd2e tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-1539296230: creating Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-ed3b4af3-7da6-4c9c-9fa3-254936b91992" released by "_delete_snapshot" :: held 2.036s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0e9d7ff9-6037-4306-b1fc-af8974cebd2e tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-1539296230: created successfully Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" released by "delete_snapshot" :: held 2.070s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0e9d7ff9-6037-4306-b1fc-af8974cebd2e tempest-GroupSnapshotsTest-202297514 None] Create group completed successfully. Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Created reservations ['b3cf804a-e3db-4b97-915c-671eb5a3351c', 'e60bda13-5d61-4a4c-a01b-a40b5239e6e3', '478779af-935d-4703-a23c-8df63604c867', '74fbfa14-2144-4bd3-92f8-31a33daeddeb'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Delete snapshot completed successfully. Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-362183ac-28cc-44db-a532-7f7a837e08b2 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-ed3b4af3-7da6-4c9c-9fa3-254936b91992-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-6b434ef6-8482-4758-bd90-a251867a064e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-6b434ef6-8482-4758-bd90-a251867a064e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-quobyte-6b434ef6-8482-4758-bd90-a251867a064e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-6b434ef6-8482-4758-bd90-a251867a064e" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef42d4a3-08aa-413c-a28f-795e6b43b4b3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:32 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e Jul 14 20:22:32 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:32 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:33 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e Jul 14 20:22:33 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:33 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6b434ef6-8482-4758-bd90-a251867a064e" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-6b434ef6-8482-4758-bd90-a251867a064e" released by "delete_volume" :: held 0.657s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "cinder-eb4546fd-3ae6-4805-bb04-46c62101a3cc-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-eb4546fd-3ae6-4805-bb04-46c62101a3cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Created reservations ['9223dcd8-f676-4aba-babf-232227228f36', 'd729baaf-2832-451e-b4d8-8f2421e2f32f', '36926286-db69-4e02-95df-510406043cd3', '61a7de73-0242-45af-b3df-c3fd01d646b7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "cinder-quobyte-eb4546fd-3ae6-4805-bb04-46c62101a3cc" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-quobyte-eb4546fd-3ae6-4805-bb04-46c62101a3cc" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e066e-346a-469f-bb66-6c9871453fe0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:33 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:33 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "cinder-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:33 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc Jul 14 20:22:33 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61ab1c-9e43-45e6-83ee-625ac7eb23a2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:33 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 Jul 14 20:22:33 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-37b5b61e-59eb-43d5-bd61-9b0a00beae93-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-37b5b61e-59eb-43d5-bd61-9b0a00beae93-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:34 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-quobyte-37b5b61e-59eb-43d5-bd61-9b0a00beae93" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.588s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:34 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc" returned: 0 in 0.653s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Deleted volume successfully. Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-37b5b61e-59eb-43d5-bd61-9b0a00beae93" acquired by "delete_volume" :: waited 0.053s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:34 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc Jul 14 20:22:34 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (5e5bbfeb-f57c-45a0-b4c3-0ccf2028f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efab2518-b2a2-4bc4-80e6-16ee18798834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" returned: 0 in 0.461s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4cbf39-7a01-472f-82b1-29464477c724]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937 Jul 14 20:22:34 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efab2518-b2a2-4bc4-80e6-16ee18798834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-410198486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9edfafa4-ace8-47c8-a6e9-38f1c2da554e,host='devstack@QuobyteHD#QuobyteHD',id=cf0da8db-3d07-48a6-91d4-076298e55ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:34Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8e52c9b-840b-4791-a130-74c104ff8997),volume_type_id=e8e52c9b-840b-4791-a130-74c104ff8997)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a58443-c51a-43f3-8b2c-3458d70c5e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a58443-c51a-43f3-8b2c-3458d70c5e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e634f9d4-26e7-463d-8a26-6efabe4c2b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e634f9d4-26e7-463d-8a26-6efabe4c2b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0da8db-3d07-48a6-91d4-076298e55ced', 'volume_name': 'volume-cf0da8db-3d07-48a6-91d4-076298e55ced', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96725c56-86a1-4543-87ae-d3e1082ec558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96725c56-86a1-4543-87ae-d3e1082ec558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d3cd3-a0af-47ee-82c8-8080ca62ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:34 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Volume cf0da8db-3d07-48a6-91d4-076298e55ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0da8db-3d07-48a6-91d4-076298e55ced', 'volume_size': 1} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9edfafa4-ace8-47c8-a6e9-38f1c2da554e,created_at=2026-07-14T18:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-410198486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9edfafa4-ace8-47c8-a6e9-38f1c2da554e,host='devstack@QuobyteHD#QuobyteHD',id=cf0da8db-3d07-48a6-91d4-076298e55ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:34Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8e52c9b-840b-4791-a130-74c104ff8997),volume_type_id=e8e52c9b-840b-4791-a130-74c104ff8997)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Creating volume cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:34 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a7cfef40-4514-464a-98b6-5538408390d2 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-6b434ef6-8482-4758-bd90-a251867a064e-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:34 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced 1073741824 Jul 14 20:22:34 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 Jul 14 20:22:34 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-eb4546fd-3ae6-4805-bb04-46c62101a3cc" returned: 0 in 0.457s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-quobyte-eb4546fd-3ae6-4805-bb04-46c62101a3cc" released by "delete_volume" :: held 1.167s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:34 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Created reservations ['f5bac4ff-bb4b-4c41-9e0a-fca0f2f19b21', '15fa115f-f47d-4581-9128-7da4e65264ba', 'c4655d4a-5a55-438d-af03-1e4084d1731a', 'e90e778f-c978-445a-aa6e-2edaf5a07cc4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-quobyte-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937" released by "delete_volume" :: held 1.021s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:34 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93" returned: 0 in 0.563s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93 Jul 14 20:22:34 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:34 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:34 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:34 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Created reservations ['b44d6b43-2e29-4160-9646-542df884bee7', '28e935cb-6951-478d-b965-2fe6856f8ced', '2f7162a9-c0de-4dc0-90c1-5780832ae731', '0fe02e0c-7bc1-4687-86cd-1c5ca4751aa4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced 1073741824" returned: 0 in 0.636s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:35 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:35 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:35 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:35 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:35 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-37b5b61e-59eb-43d5-bd61-9b0a00beae93" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-37b5b61e-59eb-43d5-bd61-9b0a00beae93" released by "delete_volume" :: held 1.077s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Created reservations ['85c2b615-cd20-421d-8be2-3437d3cda9dc', '97992886-8ad2-482b-bb68-23a7fa49328b', '85c1a911-a828-4b02-ab95-9c984ef038f1', '84cc9f0e-0069-45b1-84a7-4725d68ae320'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:35 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.463s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Deleted volume successfully. Jul 14 20:22:35 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.334s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d3cd3-a0af-47ee-82c8-8080ca62ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0da8db-3d07-48a6-91d4-076298e55ced', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca58420-e24a-4e5e-86c5-8250b90de35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:35 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Volume volume-cf0da8db-3d07-48a6-91d4-076298e55ced (cf0da8db-3d07-48a6-91d4-076298e55ced): created successfully Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca58420-e24a-4e5e-86c5-8250b90de35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (5e5bbfeb-f57c-45a0-b4c3-0ccf2028f263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-07fb007a-f23b-4e7f-b9af-0db2b51a51ab tempest-VolumesTransfersV357Test-6052673 None] Lock "cinder-eb4546fd-3ae6-4805-bb04-46c62101a3cc-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c0a90a51-2586-4d59-9103-8f9d6e5d7d2a tempest-GroupSnapshotsTest-202297514 None] Created volume successfully. Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:35 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.339s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:35 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:35 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Deleted volume successfully. Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-63c95836-caea-4869-8d32-266d46de28d4 tempest-VolumesSnapshotNegativeTestJSON-1481555310 None] Lock "cinder-de31d6fa-e2a9-4bf5-9d8e-e20ae4cc6937-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:35 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Deleted volume successfully. Jul 14 20:22:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ca4973f7-8b62-4b3d-83ed-84848f1b4f3d tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-37b5b61e-59eb-43d5-bd61-9b0a00beae93-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-9f0ec9d8-252d-4f0b-908f-93d783bfd13e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-9f0ec9d8-252d-4f0b-908f-93d783bfd13e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "cinder-quobyte-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aee78b-14e4-48b3-a388-854ca9e06a3f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:36 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e Jul 14 20:22:36 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] GroupSnapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: creating. Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Group snapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: creating. {{(pid=87600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Creating offline snapshot f11f6359-5834-4c56-bc6a-5fe65e3b381c of volume cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5fa7b-ab36-4f0f-a606-ca70f37822f3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:37 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:37 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:37 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" returned: 0 in 0.504s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:37 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e Jul 14 20:22:37 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:37 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.451s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:37 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:37 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c 1G Jul 14 20:22:37 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-quobyte-9f0ec9d8-252d-4f0b-908f-93d783bfd13e" released by "delete_volume" :: held 0.883s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Created reservations ['bbb2b8c4-c640-4c8b-94c0-52af828433ec', '3ad5367a-84c2-4b51-a157-b07faf008c4a', 'da9f72c9-ecd9-4579-9ca6-25ad01476d1c', '09619e21-7c61-44dd-9724-c909e3a4dd8c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:37 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:37 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:37 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c 1G" returned: 0 in 0.547s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0da8db-3d07-48a6-91d4-076298e55ced -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:37 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0da8db-3d07-48a6-91d4-076298e55ced -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:37 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:38 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.500s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Deleted volume successfully. Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cd8cc9bb-b4f4-4105-be37-2d65a641f8c7 tempest-AttachVolumeNegativeTest-31222840 None] Lock "cinder-9f0ec9d8-252d-4f0b-908f-93d783bfd13e-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:38 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf0da8db-3d07-48a6-91d4-076298e55ced -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.460s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:38 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:38 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:38 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:38 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:38 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info Jul 14 20:22:38 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:39 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info" returned: 0 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:39 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:22:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:39 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info Jul 14 20:22:39 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:39 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.info" returned: 0 in 0.301s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-95edacad-58d5-49c3-be34-bee7a460a90d tempest-GroupSnapshotsTest-202297514 None] group_snapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: created successfully Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c-523b5991-0d2a-4a3d-9e87-53be00d85f97" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c-523b5991-0d2a-4a3d-9e87-53be00d85f97" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Creating volume 523b5991-0d2a-4a3d-9e87-53be00d85f97 from snapshot f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] snapshot: f11f6359-5834-4c56-bc6a-5fe65e3b381c, volume: 523b5991-0d2a-4a3d-9e87-53be00d85f97, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adbd089-152b-4cc5-a002-e08fe77d3b0a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:41 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:41 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:41 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.499s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf0da8db-3d07-48a6-91d4-076298e55ced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b309fd-4e81-4ce5-bf88-0b88cc682b17]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:41 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:41 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:42 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.506s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:42 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:22:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:42 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 Jul 14 20:22:42 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (c6223732-9fe4-4007-a51a-a0d8c56d3020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92861311-3eb6-4120-9f0a-93a613805f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92861311-3eb6-4120-9f0a-93a613805f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989914940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e9d6ba-a05c-4207-a84a-82e7a64b7688,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:45Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ed4b15-1af3-4eb9-8af1-ec4626c5bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ed4b15-1af3-4eb9-8af1-ec4626c5bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc62da8a-854d-49e2-85f8-b6cd6b5534cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc62da8a-854d-49e2-85f8-b6cd6b5534cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e9d6ba-a05c-4207-a84a-82e7a64b7688', 'volume_name': 'volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5043ea-7e0b-4ca9-b203-a215433fa715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5043ea-7e0b-4ca9-b203-a215433fa715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9717d67b-fec6-47f6-99b2-dcaf5c371bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Volume f0e9d6ba-a05c-4207-a84a-82e7a64b7688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688', 'volume_size': 1} Jul 14 20:22:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:48 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97" returned: 0 in 6.038s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43bde0-4f8c-40a8-81f2-65bdc04950e2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:48 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:48 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:48 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.650s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:22:48 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Converted 1024.00 MB image at 169.55 MB/s Jul 14 20:22:48 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:22:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:48 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 Jul 14 20:22:48 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:49 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97" returned: 0 in 0.312s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" released by "_copy_volume_from_snapshot" :: held 8.135s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c-523b5991-0d2a-4a3d-9e87-53be00d85f97" released by "_create_volume_from_snapshot" :: held 8.168s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.190s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989914940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e9d6ba-a05c-4207-a84a-82e7a64b7688,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:45Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Creating volume f0e9d6ba-a05c-4207-a84a-82e7a64b7688 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:49 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 1073741824 Jul 14 20:22:49 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d7b6b2bd-67d2-4601-b2bd-642eb012039a tempest-GroupSnapshotsTest-202297514 None] Create group from source-snapshot-4a3da212-e3eb-45ec-8b72-113e1d66c319 completed successfully. Jul 14 20:22:49 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 1073741824" returned: 0 in 0.533s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:49 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 Jul 14 20:22:49 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:50 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9717d67b-fec6-47f6-99b2-dcaf5c371bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787ad4f-0d06-488d-b045-f0b3e8217a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Volume volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 (f0e9d6ba-a05c-4207-a84a-82e7a64b7688): created successfully Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787ad4f-0d06-488d-b045-f0b3e8217a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (c6223732-9fe4-4007-a51a-a0d8c56d3020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-48c76993-3b30-4a14-a762-d1b7f48a1bb9 tempest-VolumesListTestJSON-486908502 None] Created volume successfully. Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Flow 'volume_create_manager' (95b320ff-7093-458c-8d3a-e6e79dde32fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e88aef1-65ae-4be4-916c-491a893cc3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e88aef1-65ae-4be4-916c-491a893cc3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1239122248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbaf584-5272-4dce-a463-dd389161d98c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02a4f4a4b954424a3aa17b8183be26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:50Z,use_quota=True,user_id='0ac9352a8c9447a39605845c7c3be665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c260dcf7-a417-43ff-bc1f-96fab17fb98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c260dcf7-a417-43ff-bc1f-96fab17fb98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc6d11-30df-444e-bb60-f49f07232bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc6d11-30df-444e-bb60-f49f07232bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbaf584-5272-4dce-a463-dd389161d98c', 'volume_name': 'volume-3bbaf584-5272-4dce-a463-dd389161d98c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0b98ff-7528-455b-9c77-c8e91daac2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0b98ff-7528-455b-9c77-c8e91daac2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62893ad9-53f4-4efd-aca5-96f2ec1a5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Volume 3bbaf584-5272-4dce-a463-dd389161d98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbaf584-5272-4dce-a463-dd389161d98c', 'volume_size': 1} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1239122248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbaf584-5272-4dce-a463-dd389161d98c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a02a4f4a4b954424a3aa17b8183be26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:50Z,use_quota=True,user_id='0ac9352a8c9447a39605845c7c3be665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Creating volume 3bbaf584-5272-4dce-a463-dd389161d98c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:50 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:50 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c 1073741824 Jul 14 20:22:50 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:50 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c 1073741824" returned: 0 in 0.636s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:51 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c Jul 14 20:22:51 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" acquired by "delete_volume" :: waited 0.051s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e608fe-04f1-4338-b0eb-2ef31a8460eb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:51 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 Jul 14 20:22:51 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (392f89be-99d1-4611-8cd9-59e3b6e8a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90afe9b-736c-40fb-98ce-526e3d9f1211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90afe9b-736c-40fb-98ce-526e3d9f1211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-454991138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f7e4dd-e901-4820-99ac-558d9b7c2a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:51Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe513f-b4d0-4b94-b0d9-9fee7d0d75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe513f-b4d0-4b94-b0d9-9fee7d0d75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5fa3d4-a3b0-4657-8a33-32f2642f2674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5fa3d4-a3b0-4657-8a33-32f2642f2674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f7e4dd-e901-4820-99ac-558d9b7c2a72', 'volume_name': 'volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fbbb4b-7855-4f34-b985-8374c73fccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fbbb4b-7855-4f34-b985-8374c73fccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26295c0c-fd14-4f40-aeb6-9c60756a2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Volume c4f7e4dd-e901-4820-99ac-558d9b7c2a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72', 'volume_size': 1} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c" returned: 0 in 0.624s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-454991138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f7e4dd-e901-4820-99ac-558d9b7c2a72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:51Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Creating volume c4f7e4dd-e901-4820-99ac-558d9b7c2a72 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:51 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62893ad9-53f4-4efd-aca5-96f2ec1a5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbaf584-5272-4dce-a463-dd389161d98c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 1073741824 Jul 14 20:22:51 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14db34d4-ad67-41c1-a1c5-61a45efcf174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Volume volume-3bbaf584-5272-4dce-a463-dd389161d98c (3bbaf584-5272-4dce-a463-dd389161d98c): created successfully Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14db34d4-ad67-41c1-a1c5-61a45efcf174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Flow 'volume_create_manager' (95b320ff-7093-458c-8d3a-e6e79dde32fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-0a5e9901-9b24-4cda-a133-b1947454496d req-077fd80b-94fc-4511-92a0-f6fdea666383 tempest-VolumesGetTestJSON-1648683883 None] Created volume successfully. Jul 14 20:22:51 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97" returned: 0 in 0.584s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:51 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97 Jul 14 20:22:51 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:52 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-523b5991-0d2a-4a3d-9e87-53be00d85f97" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-523b5991-0d2a-4a3d-9e87-53be00d85f97" released by "delete_volume" :: held 0.959s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Created reservations ['436a2f43-f126-4dde-bd88-31b266ac7b5b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:52 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 1073741824" returned: 0 in 0.555s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:52 devstack cinder-volume[87600]: WARNING cinder.quota [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1458217384 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1458217384, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:22:52 devstack cinder-volume[87600]: WARNING cinder.quota [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1458217384 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1458217384, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Created reservations ['db4999a0-d49f-483d-b1ea-d8e43c7f7117', 'fbb4b1c4-7ce1-4656-b1c2-d9e090113b31', '0ef818ce-8453-400b-bb53-f66a48866ccf', '93d7cf52-784c-4932-aa0b-8345d1df5bcc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:52 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 Jul 14 20:22:52 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:52 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:52 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:52 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26295c0c-fd14-4f40-aeb6-9c60756a2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad488449-9254-4581-80d5-287d9742a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Volume volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 (c4f7e4dd-e901-4820-99ac-558d9b7c2a72): created successfully Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad488449-9254-4581-80d5-287d9742a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (392f89be-99d1-4611-8cd9-59e3b6e8a77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7daa0b3f-ba98-4722-8578-33bafd9ee82f tempest-VolumesListTestJSON-486908502 None] Created volume successfully. Jul 14 20:22:52 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ce156b7d-c14d-4b9f-b39f-685d5da272bb tempest-GroupSnapshotsTest-202297514 None] Delete group completed successfully. Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Acquiring lock "cinder-3bbaf584-5272-4dce-a463-dd389161d98c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "cinder-3bbaf584-5272-4dce-a463-dd389161d98c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Acquiring lock "cinder-quobyte-3bbaf584-5272-4dce-a463-dd389161d98c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "cinder-quobyte-3bbaf584-5272-4dce-a463-dd389161d98c" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f194c-30bd-45f0-9067-ec443e6af6ab]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:53 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c Jul 14 20:22:53 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:53 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c" returned: 0 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:53 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c Jul 14 20:22:53 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:53 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3bbaf584-5272-4dce-a463-dd389161d98c" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "cinder-quobyte-3bbaf584-5272-4dce-a463-dd389161d98c" released by "delete_volume" :: held 0.694s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: deleting Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.quota [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Created reservations ['3770398a-cbe4-4149-ae2f-1e1908f9475d', '0ee74287-25ae-4023-828a-7239858a7da3', '51eddb12-accd-44c1-94d7-21d43652a6bb', 'fdbcf417-b897-4637-946c-507413549e7a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: deleting {{(pid=87600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Deleting offline snapshot f11f6359-5834-4c56-bc6a-5fe65e3b381c of volume cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] snapshot_file for this snap is: volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:22:53 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:53 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf37e3-6edf-4941-93cc-8670790361c0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:54 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:54 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:54 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.418s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.manager [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Deleted volume successfully. Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-52b0f03b-1627-47af-8e78-30f2f40fb6e5 req-b54680a4-a809-4b2c-ac06-42d078b0d23d tempest-VolumesGetTestJSON-1648683883 None] Lock "cinder-3bbaf584-5272-4dce-a463-dd389161d98c-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (c2996f82-3188-49e0-b256-aa8c89ca6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c06c49d-22d8-4d34-8e81-7614691f6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c06c49d-22d8-4d34-8e81-7614691f6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1362502581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69095d2-4e0d-4491-837f-e4805faab8d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:54Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec2c8e1-bd5d-4e3b-98d3-ee032566aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec2c8e1-bd5d-4e3b-98d3-ee032566aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08824ad5-41ee-46cc-b852-ed82cddb4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08824ad5-41ee-46cc-b852-ed82cddb4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69095d2-4e0d-4491-837f-e4805faab8d6', 'volume_name': 'volume-c69095d2-4e0d-4491-837f-e4805faab8d6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5b0800-a43d-4f27-91ad-53c49265ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5b0800-a43d-4f27-91ad-53c49265ed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d99e36a-4568-4345-a1a1-84cf91ee157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Volume c69095d2-4e0d-4491-837f-e4805faab8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69095d2-4e0d-4491-837f-e4805faab8d6', 'volume_size': 1} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1362502581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69095d2-4e0d-4491-837f-e4805faab8d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a9831a4f12774929b39bb3b2901c19e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:22:54Z,use_quota=True,user_id='9100843777f54bd9800f799b0ef9bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Creating volume c69095d2-4e0d-4491-837f-e4805faab8d6 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:22:54 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:54 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.726s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf0da8db-3d07-48a6-91d4-076298e55ced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:22:54 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 1073741824 Jul 14 20:22:54 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd219bf-9d6b-4bc1-906c-694838717450]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:54 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:54 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:55 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.480s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:55 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:55 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:55 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 1073741824" returned: 0 in 0.747s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:55 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 Jul 14 20:22:55 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:55 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.541s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:55 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c Jul 14 20:22:55 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:55 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6" returned: 0 in 0.385s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d99e36a-4568-4345-a1a1-84cf91ee157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69095d2-4e0d-4491-837f-e4805faab8d6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2150d47-4064-4ca9-9de3-0e25fc632528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:22:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Volume volume-c69095d2-4e0d-4491-837f-e4805faab8d6 (c69095d2-4e0d-4491-837f-e4805faab8d6): created successfully Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2150d47-4064-4ca9-9de3-0e25fc632528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:22:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Flow 'volume_create_manager' (c2996f82-3188-49e0-b256-aa8c89ca6270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:22:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f691ec83-4516-4804-b679-61cd04c928a2 tempest-VolumesListTestJSON-486908502 None] Created volume successfully. Jul 14 20:22:56 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced.f11f6359-5834-4c56-bc6a-5fe65e3b381c" returned: 0 in 0.424s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-f11f6359-5834-4c56-bc6a-5fe65e3b381c" released by "_delete_snapshot" :: held 2.344s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" released by "delete_snapshot" :: held 2.422s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:56 devstack cinder-volume[87600]: WARNING cinder.quota [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1458217384 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1458217384, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:22:56 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['7dccd349-f1f0-4014-953c-6e4ccdd994d2', 'a3153c6a-d1de-4a03-973e-624b03696442', '747b7abf-d4c3-42a4-978a-cb3c52162e88', '32eacdb1-b0c1-42e0-bdde-4c9fc38b1a7d'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c1dfc63a-82f7-455c-bdcf-45b2b85dd090 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 4a3da212-e3eb-45ec-8b72-113e1d66c319: deleted successfully Jul 14 20:22:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aae99b-7809-4ce9-a24e-6550bd5e19de]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:57 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:57 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:58 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.504s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:58 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced Jul 14 20:22:58 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:58 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf0da8db-3d07-48a6-91d4-076298e55ced" returned: 0 in 0.317s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-cf0da8db-3d07-48a6-91d4-076298e55ced" released by "delete_volume" :: held 0.906s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Created reservations ['a9542512-1988-40d3-8140-3cc0bc9c8dcb'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:58 devstack cinder-volume[87600]: WARNING cinder.db.api [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1458217384'] Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Created reservations ['f98b5b5f-0814-4f2c-8ca6-81e8171d4bf9', '2302bff9-adf0-4b20-998d-bc0a0efed96f', 'dbae24ae-0d9c-4495-a9ba-f131adabbf63', 'de4ce3e6-a9b0-4a2d-8aca-5d92e69b9522'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:22:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:58 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:22:58 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:59 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.361s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:22:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f46051b7-c800-44f2-93d3-d26a23dd1a1a tempest-GroupSnapshotsTest-202297514 None] Delete group completed successfully. Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-c69095d2-4e0d-4491-837f-e4805faab8d6-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-c69095d2-4e0d-4491-837f-e4805faab8d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-quobyte-c69095d2-4e0d-4491-837f-e4805faab8d6" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-c69095d2-4e0d-4491-837f-e4805faab8d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a0154-a598-428f-b529-bd71a147d967]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:59 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 Jul 14 20:22:59 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:22:59 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6" returned: 0 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:22:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:22:59 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6 Jul 14 20:22:59 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-78f81b82-4ab2-41a7-8109-68396301f743 tempest-GroupsTest-66084352 None] Group tempest-Group1-971308232: creating Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-78f81b82-4ab2-41a7-8109-68396301f743 tempest-GroupsTest-66084352 None] Group tempest-Group1-971308232: created successfully Jul 14 20:23:00 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c69095d2-4e0d-4491-837f-e4805faab8d6" returned: 0 in 0.401s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-78f81b82-4ab2-41a7-8109-68396301f743 tempest-GroupsTest-66084352 None] Create group completed successfully. Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-c69095d2-4e0d-4491-837f-e4805faab8d6" released by "delete_volume" :: held 0.862s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5a7749f8-2c98-4cfe-892c-0a4108040774 tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-255547861: creating Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Created reservations ['5323db13-e8ce-453b-a2a9-8e41e428c2fa', '1386ccc4-c6b3-4e75-89a3-0c50c8f38fbb', 'dc4c1f64-6321-471d-b761-98fd31fc014e', '9681d88e-5558-41ae-a3a8-65f9fca921d7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5a7749f8-2c98-4cfe-892c-0a4108040774 tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-255547861: created successfully Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5a7749f8-2c98-4cfe-892c-0a4108040774 tempest-GroupSnapshotsTest-202297514 None] Create group completed successfully. Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:00 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:00 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-c4f7e4dd-e901-4820-99ac-558d9b7c2a72-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "cinder-c4f7e4dd-e901-4820-99ac-558d9b7c2a72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-quobyte-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5840774b-571a-4449-9b7f-6f57bd57e5a9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:00 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Deleted volume successfully. Jul 14 20:23:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e336b814-42ec-4242-891d-f087aa4fc4a6 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-c69095d2-4e0d-4491-837f-e4805faab8d6-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:00 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 Jul 14 20:23:00 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:01 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" returned: 0 in 0.374s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:01 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72 Jul 14 20:23:01 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:01 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" returned: 0 in 0.267s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-c4f7e4dd-e901-4820-99ac-558d9b7c2a72" released by "delete_volume" :: held 0.698s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Created reservations ['c0aeffef-bc50-4c62-9a53-63a342815245', '6140670d-9f63-4333-83c9-91d7f4f69270', '59b9fdc2-e3e3-479e-904c-595acf79b206', '18e351f2-8851-483f-a345-cd60a3b6362c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ec9284c2-04e8-4530-90fd-f3fbe7472c97 tempest-GroupsTest-66084352 None] Group tempest-Group2-82692395: creating Jul 14 20:23:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ec9284c2-04e8-4530-90fd-f3fbe7472c97 tempest-GroupsTest-66084352 None] Group tempest-Group2-82692395: created successfully Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ec9284c2-04e8-4530-90fd-f3fbe7472c97 tempest-GroupsTest-66084352 None] Create group completed successfully. Jul 14 20:23:01 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:01 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:01 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Deleted volume successfully. Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-f0e9d6ba-a05c-4207-a84a-82e7a64b7688-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e7717109-deda-41d2-b3c1-66a096ef1e2f tempest-VolumesListTestJSON-486908502 None] Lock "cinder-c4f7e4dd-e901-4820-99ac-558d9b7c2a72-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-f0e9d6ba-a05c-4207-a84a-82e7a64b7688-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "cinder-quobyte-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" acquired by "delete_volume" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (637007d1-a1a0-4862-bf59-4a7958932756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bbed21-cf79-493c-9d12-30a48b1498ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe987a8e-2c69-48b4-b72b-257bb7a4cb1f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bbed21-cf79-493c-9d12-30a48b1498ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178241885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,host='devstack@QuobyteHD#QuobyteHD',id=02343565-2e10-47f0-85dd-651065efb9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:02Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92e00bc2-e4b5-4d8c-b508-8c06d725c24c),volume_type_id=92e00bc2-e4b5-4d8c-b508-8c06d725c24c)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d669f70-0dec-4384-8c8b-4790f1758d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d669f70-0dec-4384-8c8b-4790f1758d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb39361-95ee-4781-96c3-68cf75e465ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb39361-95ee-4781-96c3-68cf75e465ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02343565-2e10-47f0-85dd-651065efb9ea', 'volume_name': 'volume-02343565-2e10-47f0-85dd-651065efb9ea', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3fa666-b93a-4242-b644-e7e9709ffb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3fa666-b93a-4242-b644-e7e9709ffb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968cdc84-c68b-4b30-9c35-e52058cb6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Volume 02343565-2e10-47f0-85dd-651065efb9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02343565-2e10-47f0-85dd-651065efb9ea', 'volume_size': 1} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,created_at=2026-07-14T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178241885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,host='devstack@QuobyteHD#QuobyteHD',id=02343565-2e10-47f0-85dd-651065efb9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:02Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92e00bc2-e4b5-4d8c-b508-8c06d725c24c),volume_type_id=92e00bc2-e4b5-4d8c-b508-8c06d725c24c)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Creating volume 02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:02 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:02 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea 1073741824 Jul 14 20:23:02 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:02 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 Jul 14 20:23:02 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:02 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" returned: 0 in 0.439s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:02 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688 Jul 14 20:23:02 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:02 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea 1073741824" returned: 0 in 0.461s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:02 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea Jul 14 20:23:02 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:02 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" returned: 0 in 0.318s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-quobyte-f0e9d6ba-a05c-4207-a84a-82e7a64b7688" released by "delete_volume" :: held 0.829s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Created reservations ['6470cb3c-349e-45d0-814d-911eddc124a4', '31ac0a2d-e642-459e-a477-0efd26d72098', '76d4766d-132b-4dbf-a568-a60f21366138', '87cf39aa-23a3-4fdc-9171-2376e9993c9e'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:03 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:03 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:03 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea" returned: 0 in 0.435s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968cdc84-c68b-4b30-9c35-e52058cb6df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02343565-2e10-47f0-85dd-651065efb9ea', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e02938-381e-4923-889c-e2221019b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Volume volume-02343565-2e10-47f0-85dd-651065efb9ea (02343565-2e10-47f0-85dd-651065efb9ea): created successfully Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e02938-381e-4923-889c-e2221019b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (637007d1-a1a0-4862-bf59-4a7958932756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:03 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:03 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (20cbc132-05b3-47ad-bd91-036c31608602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4d84c9-a44e-488d-8284-3ef0e8c1d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4d84c9-a44e-488d-8284-3ef0e8c1d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c534f4ea-ec40-426a-92fa-4782d94c98cc,host='devstack@QuobyteHD#QuobyteHD',id=8abda9af-cc93-4015-9734-c4e124cb507d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:03Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f47df9d-0a6f-46ef-b9cb-f4e64a09cf91),volume_type_id=2f47df9d-0a6f-46ef-b9cb-f4e64a09cf91)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b183cd37-4313-4375-888c-ed15a7a2ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b183cd37-4313-4375-888c-ed15a7a2ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562f10b3-dd77-46ec-b16d-f170d3c11237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562f10b3-dd77-46ec-b16d-f170d3c11237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abda9af-cc93-4015-9734-c4e124cb507d', 'volume_name': 'volume-8abda9af-cc93-4015-9734-c4e124cb507d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd272dc-ce64-4289-a7f0-436ec643cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd272dc-ce64-4289-a7f0-436ec643cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fcaa11-d876-4d77-afd6-3102963ee07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Volume 8abda9af-cc93-4015-9734-c4e124cb507d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abda9af-cc93-4015-9734-c4e124cb507d', 'volume_size': 1} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c534f4ea-ec40-426a-92fa-4782d94c98cc,created_at=2026-07-14T18:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c534f4ea-ec40-426a-92fa-4782d94c98cc,host='devstack@QuobyteHD#QuobyteHD',id=8abda9af-cc93-4015-9734-c4e124cb507d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:03Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f47df9d-0a6f-46ef-b9cb-f4e64a09cf91),volume_type_id=2f47df9d-0a6f-46ef-b9cb-f4e64a09cf91)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Creating volume 8abda9af-cc93-4015-9734-c4e124cb507d {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ba6512b1-ec6e-4a4b-bc9b-37fd8a4aa5be tempest-GroupSnapshotsTest-202297514 None] Created volume successfully. Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.532s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:03 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d 1073741824 Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:03 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Deleted volume successfully. Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c23a17c-cbe4-479f-8f71-8e33a5198a60 tempest-VolumesListTestJSON-486908502 None] Lock "cinder-f0e9d6ba-a05c-4207-a84a-82e7a64b7688-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:03 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.557s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:23:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:23:04 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d 1073741824" returned: 0 in 0.805s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:04 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d Jul 14 20:23:04 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (23023759-c4ff-4170-9351-dbc3ffeeff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1653b07-9734-45da-9c35-f1c4f842c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1653b07-9734-45da-9c35-f1c4f842c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1391988352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,host='devstack@QuobyteHD#QuobyteHD',id=b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:05Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92e00bc2-e4b5-4d8c-b508-8c06d725c24c),volume_type_id=92e00bc2-e4b5-4d8c-b508-8c06d725c24c)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adbac97-3ce8-42a5-8997-5cc0c04ba436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adbac97-3ce8-42a5-8997-5cc0c04ba436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caeccc8-4b02-4781-8dcc-48046010f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caeccc8-4b02-4781-8dcc-48046010f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7', 'volume_name': 'volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d04c6-8449-49e7-af9d-3b49981d05af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d04c6-8449-49e7-af9d-3b49981d05af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b161ae-b2fc-4f13-a770-fa15239b08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Volume b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7', 'volume_size': 1} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:04 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,created_at=2026-07-14T18:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1391988352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8ee0c5b-3d4b-4734-9762-bb22c83f6a31,host='devstack@QuobyteHD#QuobyteHD',id=b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:05Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92e00bc2-e4b5-4d8c-b508-8c06d725c24c),volume_type_id=92e00bc2-e4b5-4d8c-b508-8c06d725c24c)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Creating volume b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:04 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fcaa11-d876-4d77-afd6-3102963ee07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abda9af-cc93-4015-9734-c4e124cb507d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 1073741824 Jul 14 20:23:04 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17be83e3-b75f-4e24-912c-424ba2c2f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Volume volume-8abda9af-cc93-4015-9734-c4e124cb507d (8abda9af-cc93-4015-9734-c4e124cb507d): created successfully Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17be83e3-b75f-4e24-912c-424ba2c2f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (20cbc132-05b3-47ad-bd91-036c31608602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-815982a2-aa64-406d-9ef2-b78be969084d tempest-GroupsTest-66084352 None] Created volume successfully. Jul 14 20:23:05 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 1073741824" returned: 0 in 0.587s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:05 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 Jul 14 20:23:05 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:05 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b161ae-b2fc-4f13-a770-fa15239b08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cc5861-9a80-4f64-8e0f-738169a5fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Volume volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 (b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7): created successfully Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cc5861-9a80-4f64-8e0f-738169a5fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (23023759-c4ff-4170-9351-dbc3ffeeff22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d29b2100-5f94-49cc-8db2-75392d71cf26 tempest-GroupSnapshotsTest-202297514 None] Created volume successfully. Jul 14 20:23:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Acquiring lock "cinder-quobyte-8abda9af-cc93-4015-9734-c4e124cb507d" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-8abda9af-cc93-4015-9734-c4e124cb507d" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4ef81-c0df-45f8-8613-59f8967f945e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:06 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d Jul 14 20:23:06 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-630ca7b0-86bc-4639-afea-ed54c11bba99 tempest-GroupSnapshotsTest-202297514 None] Update group completed successfully. Jul 14 20:23:07 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d" returned: 0 in 0.597s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:07 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d Jul 14 20:23:07 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Flow 'volume_create_manager' (9d2b7d3c-3bae-4a6d-94bc-ed7907b1d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ca3fd-2eb5-440b-85f5-dea3a596f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ca3fd-2eb5-440b-85f5-dea3a596f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-140823531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3146cc-1afe-45fa-ab96-fb9f26e74c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdf80ba5bcc449e906698bc9d7d5e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:07Z,use_quota=True,user_id='c91f5569d96348efbf727b153dd36baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b682908-e47c-4c7a-ad56-e800e414872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b682908-e47c-4c7a-ad56-e800e414872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c17a27-9f56-49fc-96d2-ea7daa8eef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c17a27-9f56-49fc-96d2-ea7daa8eef31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3146cc-1afe-45fa-ab96-fb9f26e74c93', 'volume_name': 'volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0812b1-8ffa-4071-8f5a-9a1767d298e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0812b1-8ffa-4071-8f5a-9a1767d298e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dc676f-c114-481a-b3d1-baa0b2320e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Volume ba3146cc-1afe-45fa-ab96-fb9f26e74c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93', 'volume_size': 1} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-140823531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3146cc-1afe-45fa-ab96-fb9f26e74c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdf80ba5bcc449e906698bc9d7d5e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:07Z,use_quota=True,user_id='c91f5569d96348efbf727b153dd36baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Creating volume ba3146cc-1afe-45fa-ab96-fb9f26e74c93 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:07 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:07 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 1073741824 Jul 14 20:23:07 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:07 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8abda9af-cc93-4015-9734-c4e124cb507d" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-8abda9af-cc93-4015-9734-c4e124cb507d" released by "delete_volume" :: held 0.931s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Created reservations ['2e3d8eb6-8bd7-432a-be36-f8d173e2be49'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:07 devstack cinder-volume[87600]: WARNING cinder.quota [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-393078585 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-393078585, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:07 devstack cinder-volume[87600]: WARNING cinder.quota [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-393078585 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-393078585, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Created reservations ['99e7b710-49d0-4bb8-9964-be995bb1d355', '3877ed89-5198-4104-b8f6-81bb08030758', '4ae39faf-97b0-4388-89b0-cb91c6ad2604', 'c9e1873c-c9b1-4273-9adc-4ade779f2496'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:07 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:07 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:08 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 1073741824" returned: 0 in 0.545s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:08 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 Jul 14 20:23:08 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:08 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e9950be1-9c2f-4281-91a5-2afa927ef288 tempest-GroupsTest-66084352 None] Delete group completed successfully. Jul 14 20:23:08 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" returned: 0 in 0.287s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dc676f-c114-481a-b3d1-baa0b2320e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf5fd4a-7a99-40c6-80b5-9fb8cf58c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Volume volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 (ba3146cc-1afe-45fa-ab96-fb9f26e74c93): created successfully Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf5fd4a-7a99-40c6-80b5-9fb8cf58c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Flow 'volume_create_manager' (9d2b7d3c-3bae-4a6d-94bc-ed7907b1d198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6d72f7c0-b090-4848-956e-b4222e7f1be7 tempest-VolumesNegativeTest-1769530258 None] Created volume successfully. Jul 14 20:23:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fb8195d6-9b03-43f1-9e98-7ccce32dc425 tempest-GroupSnapshotsTest-202297514 None] Update group completed successfully. Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Created reservations ['07cf305e-63c4-40a1-8ab8-08b05a728f15'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:09 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:09 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:09 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:09 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a2c732be-75a2-485d-85d0-aa6f0b062062 tempest-GroupsTest-66084352 None] Delete group completed successfully. Jul 14 20:23:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4c5fce81-3307-467a-95f2-15cb36b6fc81 tempest-GroupSnapshotsTest-202297514 None] Update group completed successfully. Jul 14 20:23:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4ad0123c-ea33-4fb3-bae3-7017cab54fa1 tempest-GroupSnapshotsTest-202297514 None] Update group completed successfully. Jul 14 20:23:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2bd63d55-73a7-4d26-b46c-6512a8727e00 tempest-GroupsTest-66084352 None] Group tempest-GroupsTest-Group-291014897: creating Jul 14 20:23:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2bd63d55-73a7-4d26-b46c-6512a8727e00 tempest-GroupsTest-66084352 None] Group tempest-GroupsTest-Group-291014897: created successfully Jul 14 20:23:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2bd63d55-73a7-4d26-b46c-6512a8727e00 tempest-GroupsTest-66084352 None] Create group completed successfully. Jul 14 20:23:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] GroupSnapshot 937de426-64f5-4bfe-a3cf-358c4965135e: creating. Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Group snapshot 937de426-64f5-4bfe-a3cf-358c4965135e: creating. {{(pid=87600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Creating offline snapshot 633d8c0b-05cc-4bb1-952f-7b74f6092f24 of volume b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c8a8d-e42f-464e-b79e-ea2ade1e68b3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (77666257-718a-4b20-9a6d-bec706dfd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d1350-cf17-4a88-86ca-0ebb74489866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d1350-cf17-4a88-86ca-0ebb74489866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1874438160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=985a8126-5347-4718-b0b7-e9b1193cca51,host='devstack@QuobyteHD#QuobyteHD',id=13c97c17-c907-453a-8e6b-d57ebd12100a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:13Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106ee61d-092d-48a4-9971-bd5eb23b5c14),volume_type_id=106ee61d-092d-48a4-9971-bd5eb23b5c14)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353a2f3-3b44-4fe5-a2ac-960d2d913945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353a2f3-3b44-4fe5-a2ac-960d2d913945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:13 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 Jul 14 20:23:13 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29915de8-ac5d-4cf9-b8a6-d4f08c87437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29915de8-ac5d-4cf9-b8a6-d4f08c87437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c97c17-c907-453a-8e6b-d57ebd12100a', 'volume_name': 'volume-13c97c17-c907-453a-8e6b-d57ebd12100a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc88a05-a053-44e8-92eb-0e1be0ab138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc88a05-a053-44e8-92eb-0e1be0ab138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e5c164-40b9-4c64-b780-4783819500a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:13 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Volume 13c97c17-c907-453a-8e6b-d57ebd12100a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c97c17-c907-453a-8e6b-d57ebd12100a', 'volume_size': 1} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:13 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" returned: 0 in 0.518s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:13 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 1G Jul 14 20:23:13 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:14 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 1G" returned: 0 in 0.572s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:14 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 Jul 14 20:23:14 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:14 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24" returned: 0 in 0.419s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:14 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:14 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 Jul 14 20:23:14 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:14 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (f25f4a72-5f28-4716-a8bb-ac0465026f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2f3a95-00b6-44e9-904c-113c0bfd7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2f3a95-00b6-44e9-904c-113c0bfd7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1097299113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a3f51e-f2da-4045-89d9-2ed7133ed36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:15Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bba5c95b-83d4-463b-8f8d-91623bdce804),volume_type_id=bba5c95b-83d4-463b-8f8d-91623bdce804)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f643a6c9-7c6d-494a-9199-764a61b3ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f643a6c9-7c6d-494a-9199-764a61b3ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17c4432-bac7-4527-ac3d-6c057a01cf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17c4432-bac7-4527-ac3d-6c057a01cf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a3f51e-f2da-4045-89d9-2ed7133ed36a', 'volume_name': 'volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bfdfe8-c4ab-4496-a02b-256b52847aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bfdfe8-c4ab-4496-a02b-256b52847aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754bd3c8-1040-4e23-9fc2-3673f74eae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume 66a3f51e-f2da-4045-89d9-2ed7133ed36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a', 'volume_size': 1} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:14 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info Jul 14 20:23:14 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (cd86f006-2128-4d36-87a3-9eb9395a184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a8d91-623d-4fc1-8cb6-7fba9d7798c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:15 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a8d91-623d-4fc1-8cb6-7fba9d7798c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2051054735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3179901d-f333-471e-9f4e-53389bb74fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:15Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb291d69-52ad-4336-97ba-2e3400fdb121),volume_type_id=fb291d69-52ad-4336-97ba-2e3400fdb121)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0a8bd1-a325-4663-b34f-7855783d4b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0a8bd1-a325-4663-b34f-7855783d4b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad467d-b921-4ce0-bef0-08955625a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ad467d-b921-4ce0-bef0-08955625a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3179901d-f333-471e-9f4e-53389bb74fb0', 'volume_name': 'volume-3179901d-f333-471e-9f4e-53389bb74fb0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4808ed-c278-4332-a023-9538fea71ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4808ed-c278-4332-a023-9538fea71ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5b1de-a660-4ef5-8e35-acfd36b30a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume 3179901d-f333-471e-9f4e-53389bb74fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3179901d-f333-471e-9f4e-53389bb74fb0', 'volume_size': 1} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info" returned: 0 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:15 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:15 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info Jul 14 20:23:15 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:15 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.info" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Creating offline snapshot 99aba5a6-8124-4431-9bed-67adf722a582 of volume 02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9fae5d-aba5-4d70-b9a4-c4ff2f556cb6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:15 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea Jul 14 20:23:15 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:16 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea" returned: 0 in 0.661s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:16 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 1G Jul 14 20:23:16 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (ac26a235-9951-4067-b2da-05dc1a42b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161ccab8-0320-4500-809c-002a9f0ee502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161ccab8-0320-4500-809c-002a9f0ee502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1709844301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f81c36a-a595-46b6-b197-cae992038506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:17Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6be9fa0-7369-41a2-9d0b-1f8651ac732c),volume_type_id=a6be9fa0-7369-41a2-9d0b-1f8651ac732c)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab6cb5-7c43-44b1-a222-f779effb5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab6cb5-7c43-44b1-a222-f779effb5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dace244-d2f5-408c-80bd-2d4a1b191eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:16 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:23:17 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 1G" returned: 0 in 0.802s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02343565-2e10-47f0-85dd-651065efb9ea -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:17 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02343565-2e10-47f0-85dd-651065efb9ea -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 Jul 14 20:23:17 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dace244-d2f5-408c-80bd-2d4a1b191eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f81c36a-a595-46b6-b197-cae992038506', 'volume_name': 'volume-7f81c36a-a595-46b6-b197-cae992038506', 'volume_size': 1, 'image_id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1259362046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '678e49f441cb4249a44b8860674e0115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'created_at': datetime.datetime(2026, 7, 14, 18, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 23, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113c4ae4-da37-4038-8404-70d00ae80b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113c4ae4-da37-4038-8404-70d00ae80b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f915d7-4e4d-41e0-9bb5-d27b22de66da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:17 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Volume 7f81c36a-a595-46b6-b197-cae992038506: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f81c36a-a595-46b6-b197-cae992038506', 'volume_size': 1, 'image_id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1259362046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '678e49f441cb4249a44b8860674e0115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'created_at': datetime.datetime(2026, 7, 14, 18, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 23, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3/file', 'properties': {}}, 'image_service': } Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Trying to clone 7f81c36a-a595-46b6-b197-cae992038506 from image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:23:17 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02343565-2e10-47f0-85dd-651065efb9ea -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582" returned: 0 in 0.622s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:17 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:17 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 Jul 14 20:23:17 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:18 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582" returned: 0 in 0.481s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:18 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info Jul 14 20:23:18 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:18 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info" returned: 0 in 0.418s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:18 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:18 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info Jul 14 20:23:18 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:19 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.info" returned: 0 in 0.435s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.549s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.361s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1097299113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a3f51e-f2da-4045-89d9-2ed7133ed36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:15Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bba5c95b-83d4-463b-8f8d-91623bdce804),volume_type_id=bba5c95b-83d4-463b-8f8d-91623bdce804)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Creating volume 66a3f51e-f2da-4045-89d9-2ed7133ed36a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:19 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:19 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a 1073741824 Jul 14 20:23:19 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d79adef3-9f73-4d87-a172-8333019f3760 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 937de426-64f5-4bfe-a3cf-358c4965135e: created successfully Jul 14 20:23:19 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a 1073741824" returned: 0 in 0.697s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:20 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a Jul 14 20:23:20 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:20 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.043s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2051054735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3179901d-f333-471e-9f4e-53389bb74fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:15Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb291d69-52ad-4336-97ba-2e3400fdb121),volume_type_id=fb291d69-52ad-4336-97ba-2e3400fdb121)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Creating volume 3179901d-f333-471e-9f4e-53389bb74fb0 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:20 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754bd3c8-1040-4e23-9fc2-3673f74eae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:20 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 1073741824 Jul 14 20:23:20 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2742e25-de76-4d2f-8669-ed1e990a9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:20 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a (66a3f51e-f2da-4045-89d9-2ed7133ed36a): created successfully Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2742e25-de76-4d2f-8669-ed1e990a9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (f25f4a72-5f28-4716-a8bb-ac0465026f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 937de426-64f5-4bfe-a3cf-358c4965135e: deleting Jul 14 20:23:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-66cf6473-0691-433c-acad-6d8764c284e0 tempest-TestInstancesWithCinderVolumes-401153744 None] Created volume successfully. Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 937de426-64f5-4bfe-a3cf-358c4965135e: deleting {{(pid=87600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-633d8c0b-05cc-4bb1-952f-7b74f6092f24" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-633d8c0b-05cc-4bb1-952f-7b74f6092f24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Deleting offline snapshot 633d8c0b-05cc-4bb1-952f-7b74f6092f24 of volume b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] snapshot_file for this snap is: volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1c668b-fc89-472f-be1d-e59a6b6c5aa3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:20 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 Jul 14 20:23:20 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:21 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 1073741824" returned: 0 in 0.729s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:21 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 Jul 14 20:23:21 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:21 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24" returned: 0 in 0.615s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a3b23-297b-44ab-95bf-5fec102b4362]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:21 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 Jul 14 20:23:21 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:21 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.266s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=985a8126-5347-4718-b0b7-e9b1193cca51,created_at=2026-07-14T18:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1874438160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=985a8126-5347-4718-b0b7-e9b1193cca51,host='devstack@QuobyteHD#QuobyteHD',id=13c97c17-c907-453a-8e6b-d57ebd12100a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:13Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106ee61d-092d-48a4-9971-bd5eb23b5c14),volume_type_id=106ee61d-092d-48a4-9971-bd5eb23b5c14)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Creating volume 13c97c17-c907-453a-8e6b-d57ebd12100a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:21 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5b1de-a660-4ef5-8e35-acfd36b30a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3179901d-f333-471e-9f4e-53389bb74fb0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02341bc3-6c09-4634-ae24-67b03462d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:21 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a 1073741824 Jul 14 20:23:21 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Volume volume-3179901d-f333-471e-9f4e-53389bb74fb0 (3179901d-f333-471e-9f4e-53389bb74fb0): created successfully Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02341bc3-6c09-4634-ae24-67b03462d769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (cd86f006-2128-4d36-87a3-9eb9395a184e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6fa45e12-793a-47e8-b20a-0aefe4a2e2c6 tempest-TestInstancesWithCinderVolumes-401153744 None] Created volume successfully. Jul 14 20:23:21 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:21 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 Jul 14 20:23:21 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:22 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a 1073741824" returned: 0 in 0.579s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:22 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24" returned: 0 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:22 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a Jul 14 20:23:22 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:22 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24 Jul 14 20:23:22 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:22 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a" returned: 0 in 0.291s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:22 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7.633d8c0b-05cc-4bb1-952f-7b74f6092f24" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e5c164-40b9-4c64-b780-4783819500a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c97c17-c907-453a-8e6b-d57ebd12100a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706b306b-74c0-456c-9956-6b6bb2655865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-633d8c0b-05cc-4bb1-952f-7b74f6092f24" released by "_delete_snapshot" :: held 1.863s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" released by "delete_snapshot" :: held 1.893s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Volume volume-13c97c17-c907-453a-8e6b-d57ebd12100a (13c97c17-c907-453a-8e6b-d57ebd12100a): created successfully Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706b306b-74c0-456c-9956-6b6bb2655865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (77666257-718a-4b20-9a6d-bec706dfd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-99aba5a6-8124-4431-9bed-67adf722a582" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e83b3e9b-4b5e-4cc0-9241-f0596890c6dc tempest-GroupsTest-66084352 None] Created volume successfully. Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-99aba5a6-8124-4431-9bed-67adf722a582" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Deleting offline snapshot 99aba5a6-8124-4431-9bed-67adf722a582 of volume 02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] snapshot_file for this snap is: volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[05279a47-9771-446f-9af3-22a60e9e4cab]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:22 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 Jul 14 20:23:22 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:22 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582" returned: 0 in 0.401s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02343565-2e10-47f0-85dd-651065efb9ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17eebeb-a5f3-494c-87f9-58b2ca06cf71]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:23 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea Jul 14 20:23:23 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD, size 20.69 MB, duration 5.80 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:23:23 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Image download 20.69 MB at 3.57 MB/s Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee9551-7a81-4555-aab3-5df607d2e1ef]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:23 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD Jul 14 20:23:23 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:23 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:23 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 Jul 14 20:23:23 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:23 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Temporary image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 is fetched for user ad6a129c8fa540b3ad7f1d50c03e0935. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=172,cinder:UPDATE=184,cinder:INSERT=47,cinder:DELETE=14 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=171,cinder:UPDATE=196,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec9831-90ad-4950-af8f-7c3d7fdaefb2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:23 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD Jul 14 20:23:23 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:23 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582" returned: 0 in 0.580s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:23 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582 Jul 14 20:23:23 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (eb2639b3-dd22-4c13-bd8e-64e05aa86928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f05583-9752-4991-9510-06e7a36c8e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f05583-9752-4991-9510-06e7a36c8e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355414413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=985a8126-5347-4718-b0b7-e9b1193cca51,host='devstack@QuobyteHD#QuobyteHD',id=ba48159c-390a-4e94-869b-9e6bc65c07ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:24Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106ee61d-092d-48a4-9971-bd5eb23b5c14),volume_type_id=106ee61d-092d-48a4-9971-bd5eb23b5c14)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a20cc8-c12d-49d5-bfd8-ad2af1348332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a20cc8-c12d-49d5-bfd8-ad2af1348332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b38e35-f24b-450a-9eb9-82a11f206e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b38e35-f24b-450a-9eb9-82a11f206e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba48159c-390a-4e94-869b-9e6bc65c07ba', 'volume_name': 'volume-ba48159c-390a-4e94-869b-9e6bc65c07ba', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc21f5-d5e2-44f0-9bc8-41e57b21d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc21f5-d5e2-44f0-9bc8-41e57b21d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4b79bc-6c36-4897-a5cf-71732ddde448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Volume ba48159c-390a-4e94-869b-9e6bc65c07ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba48159c-390a-4e94-869b-9e6bc65c07ba', 'volume_size': 1} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=985a8126-5347-4718-b0b7-e9b1193cca51,created_at=2026-07-14T18:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355414413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=985a8126-5347-4718-b0b7-e9b1193cca51,host='devstack@QuobyteHD#QuobyteHD',id=ba48159c-390a-4e94-869b-9e6bc65c07ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537e86605e364da4b0426cc969ac819d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:24Z,use_quota=True,user_id='1cfd7cbcf7ad4d429f44a7445aedf61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106ee61d-092d-48a4-9971-bd5eb23b5c14),volume_type_id=106ee61d-092d-48a4-9971-bd5eb23b5c14)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Creating volume ba48159c-390a-4e94-869b-9e6bc65c07ba {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:24 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba 1073741824 Jul 14 20:23:24 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:24 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:24 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea.99aba5a6-8124-4431-9bed-67adf722a582" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-99aba5a6-8124-4431-9bed-67adf722a582" released by "_delete_snapshot" :: held 1.818s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" released by "delete_snapshot" :: held 1.845s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:24 devstack cinder-volume[87600]: WARNING cinder.quota [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-594932367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-594932367, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:24 devstack cinder-volume[87600]: WARNING cinder.quota [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-594932367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-594932367, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['ea8de79e-ad26-4c57-887f-e6f33aa3c149', '3b85c895-744c-4e3e-aa8e-ebcbe031f0bc', '8056e636-28f8-4040-be4f-4071c9371a0f', '319b32c6-164b-4094-b7f5-643cb8521ab0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['3785961d-b085-4203-8003-0ef4d4bbf908', 'bc4c987a-7fd2-4b22-a61e-115b634b8e5c', 'f390cd16-331c-48ba-bb14-0c431465cc1c', '9c0dcd20-56ce-4889-9a16-ec98bd2b6653'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:24 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba 1073741824" returned: 0 in 0.517s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6a386f0e-93b9-4654-837a-04d5d80f5f60 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 937de426-64f5-4bfe-a3cf-358c4965135e: deleted successfully Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:24 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba Jul 14 20:23:24 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:24 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1709844301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f81c36a-a595-46b6-b197-cae992038506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e49f441cb4249a44b8860674e0115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:17Z,use_quota=True,user_id='ad6a129c8fa540b3ad7f1d50c03e0935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6be9fa0-7369-41a2-9d0b-1f8651ac732c),volume_type_id=a6be9fa0-7369-41a2-9d0b-1f8651ac732c)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Creating volume 7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4b79bc-6c36-4897-a5cf-71732ddde448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba48159c-390a-4e94-869b-9e6bc65c07ba', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1073741824 Jul 14 20:23:24 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7ef263-63aa-4922-bd24-ac5bfbae0297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Volume volume-ba48159c-390a-4e94-869b-9e6bc65c07ba (ba48159c-390a-4e94-869b-9e6bc65c07ba): created successfully Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7ef263-63aa-4922-bd24-ac5bfbae0297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Flow 'volume_create_manager' (eb2639b3-dd22-4c13-bd8e-64e05aa86928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d69e21c5-cfee-45bd-aef7-b06655ce6e24 tempest-GroupsTest-66084352 None] Created volume successfully. Jul 14 20:23:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f3f6c78a-a14a-4f54-8342-ec37f75a55a9 tempest-GroupsTest-66084352 None] Update group completed successfully. Jul 14 20:23:25 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1073741824" returned: 0 in 0.548s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:25 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:25 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbeff18-1e23-4e6c-966d-dda7a043efa6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:25 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Attempting download of 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}])) to volume 7f81c36a-a595-46b6-b197-cae992038506. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85bd28-2911-49f5-b860-f6634828e423]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:25 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea Jul 14 20:23:25 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:25 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a Jul 14 20:23:25 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:26 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea" returned: 0 in 0.394s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:26 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea Jul 14 20:23:26 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:26 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a" returned: 0 in 0.336s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:26 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a Jul 14 20:23:26 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:26 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-02343565-2e10-47f0-85dd-651065efb9ea" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-02343565-2e10-47f0-85dd-651065efb9ea" released by "delete_volume" :: held 0.753s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f79b631-2c17-438f-aeb4-f0e0a280b32f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:26 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a" returned: 1 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_nj2ef40a' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6507d2f4-7d72-47ee-9e66-0d499c0a9ff9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:26 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 Jul 14 20:23:26 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-95c67241-2ea6-4a3b-844c-26e630eaf25b tempest-GroupsTest-66084352 None] Update group completed successfully. Jul 14 20:23:26 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD Jul 14 20:23:26 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:26 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:26 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7 Jul 14 20:23:26 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:27 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 was qcow2, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:27 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:27 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:27 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-b3cf3ba0-e5f6-4509-bb6a-32c713a4dde7" released by "delete_volume" :: held 0.721s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['bb83e5fd-295e-4083-97b9-9382c41cd421'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:27 devstack cinder-volume[87600]: WARNING cinder.quota [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-594932367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-594932367, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['f800a735-3559-4079-a107-629aecf15a55', 'aa53b0a5-2021-4883-92ee-49ce2c26a76f', 'e70de893-e22e-4cc0-8234-ae1494c60950', 'ab0df3bd-783f-438b-82bd-61a25e085df5'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['f9677e44-79f1-4251-89fa-04e1d42da21b', '21c2258b-9870-469d-9fdb-e34115161396', 'd0975416-3859-4fc8-91a1-41bf7b0441a3', '0c39bcb8-75a9-49a2-8a4b-3319a6eaf6c2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:27 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:27 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:27 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.343s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:27 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-86800d19-8c11-406f-b982-6b64a60949e2 tempest-GroupSnapshotsTest-202297514 None] Delete group completed successfully. Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Acquiring lock "cinder-quobyte-13c97c17-c907-453a-8e6b-d57ebd12100a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-13c97c17-c907-453a-8e6b-d57ebd12100a" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ad734-2f7f-41d6-9d5a-da2fa0bea2cf]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:28 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a Jul 14 20:23:28 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-55c00aed-0706-424b-b082-261a1902e909 tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-973106427: creating Jul 14 20:23:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-55c00aed-0706-424b-b082-261a1902e909 tempest-GroupSnapshotsTest-202297514 None] Group tempest-GroupSnapshotsTest-Group-973106427: created successfully Jul 14 20:23:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-55c00aed-0706-424b-b082-261a1902e909 tempest-GroupSnapshotsTest-202297514 None] Create group completed successfully. Jul 14 20:23:28 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 1.937s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3_sl45du7edevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:23:28 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Converted 112.00 MB image at 57.78 MB/s Jul 14 20:23:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:28 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1G Jul 14 20:23:28 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a" returned: 0 in 0.510s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a Jul 14 20:23:29 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 1G" returned: 0 in 0.303s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Acquiring lock "cinder-ba3146cc-1afe-45fa-ab96-fb9f26e74c93-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "cinder-ba3146cc-1afe-45fa-ab96-fb9f26e74c93-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118c47f-e039-4062-8245-08cab2d0e9e3]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-13c97c17-c907-453a-8e6b-d57ebd12100a" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-13c97c17-c907-453a-8e6b-d57ebd12100a" released by "delete_volume" :: held 0.875s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Acquiring lock "cinder-quobyte-ba48159c-390a-4e94-869b-9e6bc65c07ba" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-ba48159c-390a-4e94-869b-9e6bc65c07ba" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Acquiring lock "cinder-quobyte-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[88988f87-76a5-409a-a156-67528441e77b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "cinder-quobyte-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:29 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:29 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a5a59-5a5a-4cc8-a0d9-a0bf498e1492]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba Jul 14 20:23:29 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 Jul 14 20:23:29 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 0.450s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba" returned: 0 in 0.412s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" returned: 0 in 0.410s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:29 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba Jul 14 20:23:29 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93 Jul 14 20:23:29 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:29 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:29 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:30 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba48159c-390a-4e94-869b-9e6bc65c07ba" returned: 0 in 0.309s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "cinder-quobyte-ba48159c-390a-4e94-869b-9e6bc65c07ba" released by "delete_volume" :: held 0.789s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:30 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" returned: 0 in 0.311s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "cinder-quobyte-ba3146cc-1afe-45fa-ab96-fb9f26e74c93" released by "delete_volume" :: held 0.792s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:30 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 1 in 0.515s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Downloaded image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}])) to volume 7f81c36a-a595-46b6-b197-cae992038506 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Temporary image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 for user ad6a129c8fa540b3ad7f1d50c03e0935 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Marking volume 7f81c36a-a595-46b6-b197-cae992038506 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Copying metadata from image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 to 7f81c36a-a595-46b6-b197-cae992038506. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Creating volume glance metadata for volume 7f81c36a-a595-46b6-b197-cae992038506 backed by image 6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3 with: {'image_id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'image_name': 'tempest-scenario-img--1259362046', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Created reservations ['120f1267-a422-44de-a212-389133551198', '5f682c96-df9b-446e-bad6-004df03a216b', '10187b9a-942f-45c1-9dc9-01cc7f8f3c1d', '1713b582-7731-4ead-9226-0cba00681a84'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Created reservations ['648e5f0c-ea01-4e86-b830-d8918099a4fc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:30 devstack cinder-volume[87600]: WARNING cinder.quota [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-749843271 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-749843271, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:30 devstack cinder-volume[87600]: WARNING cinder.quota [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-749843271 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-749843271, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (b97fef4e-d638-47b4-8924-3435d434422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a802a-4221-406d-bc61-cfd00c4d77d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261a802a-4221-406d-bc61-cfd00c4d77d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552250924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d02f0d73-3625-44aa-9250-dcf2dd54bbaa,host='devstack@QuobyteHD#QuobyteHD',id=d3e44cba-3bdc-4ac9-88ea-414f605acebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:30Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022dd5c4-59bb-4198-80b3-d21d50adc184),volume_type_id=022dd5c4-59bb-4198-80b3-d21d50adc184)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:30 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18d49e8-1048-4d06-99d6-ad0e462d9adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18d49e8-1048-4d06-99d6-ad0e462d9adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d56606-bcd1-4606-9691-33b70667dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d56606-bcd1-4606-9691-33b70667dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e44cba-3bdc-4ac9-88ea-414f605acebf', 'volume_name': 'volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595c9f8b-970f-49d7-ae95-b7fa8976d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595c9f8b-970f-49d7-ae95-b7fa8976d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49475543-916c-4373-9446-6323630acadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Volume d3e44cba-3bdc-4ac9-88ea-414f605acebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf', 'volume_size': 1} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d02f0d73-3625-44aa-9250-dcf2dd54bbaa,created_at=2026-07-14T18:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552250924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d02f0d73-3625-44aa-9250-dcf2dd54bbaa,host='devstack@QuobyteHD#QuobyteHD',id=d3e44cba-3bdc-4ac9-88ea-414f605acebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a91294940d40aea453021c65ffc8f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:30Z,use_quota=True,user_id='002413f5339c40b6969b41dd88a3aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(022dd5c4-59bb-4198-80b3-d21d50adc184),volume_type_id=022dd5c4-59bb-4198-80b3-d21d50adc184)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Creating volume d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:30 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f915d7-4e4d-41e0-9bb5-d27b22de66da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f81c36a-a595-46b6-b197-cae992038506', 'volume_size': 1, 'image_id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1259362046', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '678e49f441cb4249a44b8860674e0115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3', 'created_at': datetime.datetime(2026, 7, 14, 18, 23, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 23, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f0ef6fc-73da-46c8-8c54-ebf0b5937cd3/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf 1073741824 Jul 14 20:23:30 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cf973a-5241-49cb-b8b4-621ba775dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Created reservations ['2eecd7c7-f885-4e78-9ee0-768fd7dee93a', 'c0fef374-d922-43b3-8d72-6116a349e0c2', '5208824e-1071-4759-810f-7492cbcd84b4', 'c9771d8c-902c-4a9d-ae1e-29af93fa8577'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Volume volume-7f81c36a-a595-46b6-b197-cae992038506 (7f81c36a-a595-46b6-b197-cae992038506): created successfully Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cf973a-5241-49cb-b8b4-621ba775dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Flow 'volume_create_manager' (ac26a235-9951-4067-b2da-05dc1a42b693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-52004df3-9c4c-404e-8c32-d8846044099c tempest-TestInstancesWithCinderVolumes-401153744 None] Created volume successfully. Jul 14 20:23:30 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.288s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Deleted volume successfully. Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e203ff0d-f5da-4bc9-a4be-59fb7f6b2f73 tempest-VolumesNegativeTest-1769530258 None] Lock "cinder-ba3146cc-1afe-45fa-ab96-fb9f26e74c93-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Created reservations ['ffb73e4c-b942-4dc0-9934-ddf5cac481ba', '102bb9b5-ab2b-4871-8f8a-95dc91b5ce4c', '94b6f705-fde8-4682-8ad6-097812b5648f', 'cd2d74e3-b284-4407-a8bd-71d22b5840da'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:31 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:31 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:31 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf 1073741824" returned: 0 in 0.599s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:31 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf Jul 14 20:23:31 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:31 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.342s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-417e26cb-2325-4ac5-88ed-37e3887ace04 tempest-GroupsTest-66084352 None] Delete group completed successfully. Jul 14 20:23:31 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49475543-916c-4373-9446-6323630acadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1f6e89-f21b-42fe-a204-692257a695ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:31 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Volume volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf (d3e44cba-3bdc-4ac9-88ea-414f605acebf): created successfully Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1f6e89-f21b-42fe-a204-692257a695ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Flow 'volume_create_manager' (b97fef4e-d638-47b4-8924-3435d434422e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-eaf5c114-d2eb-4a99-b200-bf0fd38ded13 tempest-GroupSnapshotsTest-202297514 None] Created volume successfully. Jul 14 20:23:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] GroupSnapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: creating. Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Group snapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: creating. {{(pid=87600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Creating offline snapshot ceb49d5e-1619-4cb5-b621-27daafc94256 of volume d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db01102-b846-42de-bb75-550b8342f16d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:33 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf Jul 14 20:23:33 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:33 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf" returned: 0 in 0.572s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:33 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 1G Jul 14 20:23:33 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:34 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 1G" returned: 0 in 0.713s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:34 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 Jul 14 20:23:34 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:35 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256" returned: 0 in 0.572s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:35 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:35 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 Jul 14 20:23:35 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:35 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256" returned: 0 in 0.319s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:35 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info Jul 14 20:23:35 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:35 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info" returned: 0 in 0.351s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:35 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:23:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:35 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info Jul 14 20:23:35 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:36 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.info" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.215s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ea5747-a693-41f4-87bc-2c47265a1870]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5ed7c576-2237-48a7-b489-0fd7101c6f84 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: created successfully Jul 14 20:23:36 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:36 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:36 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: deleting Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: deleting {{(pid=87600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:36 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:23:36 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-ceb49d5e-1619-4cb5-b621-27daafc94256" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-ceb49d5e-1619-4cb5-b621-27daafc94256" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Deleting offline snapshot ceb49d5e-1619-4cb5-b621-27daafc94256 of volume d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] snapshot_file for this snap is: volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306d10d-f115-47b6-aae6-c34d2daffd89]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:37 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 Jul 14 20:23:37 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:37 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 1 in 0.576s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.108s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-7f81c36a-a595-46b6-b197-cae992038506', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '672b705b-e2da-4155-bd59-edc49686f870', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:23:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-05232f47-7b00-4365-a994-d4c4557185e9 req-ef3dd2bc-3c82-4a5b-a7b1-895adaa2f5d3 tempest-TestInstancesWithCinderVolumes-401153744 None] attachment_update completed successfully. Jul 14 20:23:37 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256" returned: 0 in 0.768s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f612fb-008f-416f-87ad-b408b1ad1b96]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:38 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf Jul 14 20:23:38 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:38 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf" returned: 0 in 0.561s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:38 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 Jul 14 20:23:38 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:38 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256" returned: 0 in 0.521s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:38 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256 Jul 14 20:23:38 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:39 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf.ceb49d5e-1619-4cb5-b621-27daafc94256" returned: 0 in 0.482s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-ceb49d5e-1619-4cb5-b621-27daafc94256" released by "_delete_snapshot" :: held 2.487s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" released by "delete_snapshot" :: held 2.528s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:39 devstack cinder-volume[87600]: WARNING cinder.quota [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1770583216 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1770583216, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:39 devstack cinder-volume[87600]: WARNING cinder.quota [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1770583216 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1770583216, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:39 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] Created reservations ['06238f33-d585-4af0-94a6-b9898099c4a5', 'c84c859b-4f33-4487-9702-c25f69c88751', '04b2cfe5-5215-4213-b4f0-11a342298ee0', '8bedc412-448e-432d-a5e4-b1672d591579'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6a35d61d-3ed9-42b8-a833-5a47eeb03bc2 tempest-GroupSnapshotsTest-202297514 None] group_snapshot 6cd7d1bd-7f79-49ff-a1e7-977dea094a9d: deleted successfully Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0399b5-a8df-4d9d-9f51-a4a7029ff144]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:41 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf Jul 14 20:23:41 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:41 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf" returned: 0 in 0.513s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:41 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf Jul 14 20:23:41 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:42 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d3e44cba-3bdc-4ac9-88ea-414f605acebf" returned: 0 in 0.532s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Lock "cinder-quobyte-d3e44cba-3bdc-4ac9-88ea-414f605acebf" released by "delete_volume" :: held 1.187s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Created reservations ['e046c04e-9615-47f5-9c73-d0a82755130c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:42 devstack cinder-volume[87600]: WARNING cinder.quota [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1770583216 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1770583216, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Created reservations ['d2331c2d-738f-4707-ac7e-6bc4d7730483', '2818c03d-ec7d-48c1-b3b8-753519f6aaaf', 'e7bc2ff9-7ae2-40fd-b4e1-cb30619c97d6', '90bb2286-c3a9-456e-b147-c8f0f65779f9'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:42 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:42 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:43 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:43 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9d81eeb4-d3fd-45bb-b1d3-44ec306016bb tempest-GroupSnapshotsTest-202297514 None] Delete group completed successfully. Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (89e37908-f230-426d-8822-db04e4e230b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4ab1db-d2ce-4da3-8979-a47179ab4d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4ab1db-d2ce-4da3-8979-a47179ab4d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2462040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5184b0e-2a1a-4115-9204-f866111d1624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:48Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e6701a-ca30-4c09-abec-83197431ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e6701a-ca30-4c09-abec-83197431ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457c6091-6480-4aef-aa5b-7c53a72f91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457c6091-6480-4aef-aa5b-7c53a72f91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5184b0e-2a1a-4115-9204-f866111d1624', 'volume_name': 'volume-b5184b0e-2a1a-4115-9204-f866111d1624', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84efd356-5879-4126-b9e7-e478cdd317c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84efd356-5879-4126-b9e7-e478cdd317c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d45a5d-17e5-4631-9917-02965f4096df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:47 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Volume b5184b0e-2a1a-4115-9204-f866111d1624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5184b0e-2a1a-4115-9204-f866111d1624', 'volume_size': 1} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2462040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5184b0e-2a1a-4115-9204-f866111d1624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:48Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Creating volume b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:47 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:48 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 1073741824 Jul 14 20:23:48 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:48 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 1073741824" returned: 0 in 0.674s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:48 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 Jul 14 20:23:48 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:49 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624" returned: 0 in 0.391s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d45a5d-17e5-4631-9917-02965f4096df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5184b0e-2a1a-4115-9204-f866111d1624', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49fd1e5-c0ec-48ce-a9a1-9075bc75645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Volume volume-b5184b0e-2a1a-4115-9204-f866111d1624 (b5184b0e-2a1a-4115-9204-f866111d1624): created successfully Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49fd1e5-c0ec-48ce-a9a1-9075bc75645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (89e37908-f230-426d-8822-db04e4e230b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-957f5a98-dbfa-4023-be3e-f10f57511336 tempest-VolumesSnapshotTestJSON-314302992 None] Created volume successfully. Jul 14 20:23:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Creating offline snapshot fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 of volume b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:23:50 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8010e6ee-9619-43ac-be30-0120f72415dc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:50 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 Jul 14 20:23:50 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:51 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:51 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 1G Jul 14 20:23:51 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:51 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 1G" returned: 0 in 0.499s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5184b0e-2a1a-4115-9204-f866111d1624 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:51 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5184b0e-2a1a-4115-9204-f866111d1624 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 Jul 14 20:23:51 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:52 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5184b0e-2a1a-4115-9204-f866111d1624 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" returned: 0 in 0.551s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:52 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 is being set with open permissions: ugo+rw Jul 14 20:23:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:52 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 Jul 14 20:23:52 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:52 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:52 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info Jul 14 20:23:52 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:53 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info" returned: 0 in 0.462s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info is being set with open permissions: ugo+rw Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:53 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info Jul 14 20:23:53 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:53 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Flow 'volume_create_manager' (50b36fe8-fe5b-401f-ae3c-30859d20f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08cb4d2-dbae-4885-b448-5e28ba369da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.info" returned: 0 in 0.738s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08cb4d2-dbae-4885-b448-5e28ba369da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1744096070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbda238-d9b0-4fab-8ff0-8507828caeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc4945ac22834efabf17e20a1d689b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:54Z,use_quota=True,user_id='3babd68aa5d24279820e13f02fb09d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6efc8752-bdb5-4032-b7e1-809a09058216),volume_type_id=6efc8752-bdb5-4032-b7e1-809a09058216)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcc448-8f1e-45c1-baf2-c3c3598e2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcc448-8f1e-45c1-baf2-c3c3598e2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ae34da-883a-4ee6-9034-69eb51f9fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ae34da-883a-4ee6-9034-69eb51f9fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbda238-d9b0-4fab-8ff0-8507828caeda', 'volume_name': 'volume-adbda238-d9b0-4fab-8ff0-8507828caeda', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff597c6-a869-4cef-95bc-373afcf7b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff597c6-a869-4cef-95bc-373afcf7b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77efcea0-9d53-4839-bb3f-123476812fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Volume adbda238-d9b0-4fab-8ff0-8507828caeda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbda238-d9b0-4fab-8ff0-8507828caeda', 'volume_size': 1} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1744096070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbda238-d9b0-4fab-8ff0-8507828caeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc4945ac22834efabf17e20a1d689b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:54Z,use_quota=True,user_id='3babd68aa5d24279820e13f02fb09d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6efc8752-bdb5-4032-b7e1-809a09058216),volume_type_id=6efc8752-bdb5-4032-b7e1-809a09058216)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Creating volume adbda238-d9b0-4fab-8ff0-8507828caeda {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:53 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:53 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda 1073741824 Jul 14 20:23:53 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-15957c5f-21f9-4f14-b88a-7e454488d42a tempest-VolumesSnapshotTestJSON-314302992 None] Create snapshot completed successfully Jul 14 20:23:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-906c429e-bf90-468d-832c-aa4d93f7b90c tempest-GroupsV314Test-763983784 None] Group tempest-GroupsV314Test-Group-553768544: creating Jul 14 20:23:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-906c429e-bf90-468d-832c-aa4d93f7b90c tempest-GroupsV314Test-763983784 None] Group tempest-GroupsV314Test-Group-553768544: created successfully Jul 14 20:23:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-906c429e-bf90-468d-832c-aa4d93f7b90c tempest-GroupsV314Test-763983784 None] Create group completed successfully. Jul 14 20:23:54 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda 1073741824" returned: 0 in 0.706s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:54 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda Jul 14 20:23:54 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:54 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda" returned: 0 in 0.310s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77efcea0-9d53-4839-bb3f-123476812fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbda238-d9b0-4fab-8ff0-8507828caeda', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e8567-113a-4475-9d2b-2c3093359a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Volume volume-adbda238-d9b0-4fab-8ff0-8507828caeda (adbda238-d9b0-4fab-8ff0-8507828caeda): created successfully Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483e8567-113a-4475-9d2b-2c3093359a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Flow 'volume_create_manager' (50b36fe8-fe5b-401f-ae3c-30859d20f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8a8327b2-8338-43db-86ae-0b4e0971b8ec tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Created volume successfully. Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Deleting offline snapshot fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 of volume b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] snapshot_file for this snap is: volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f9cb7e-841c-4575-ae0c-58ec9ebf5bb0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:55 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 Jul 14 20:23:55 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:55 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" returned: 0 in 0.657s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5184b0e-2a1a-4115-9204-f866111d1624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c447dfd-56bd-4d2f-9218-48152a1b801f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:56 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 Jul 14 20:23:56 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Flow 'volume_create_manager' (b6921888-5c32-4fa8-972d-8f0922248223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aad0f59-8fff-4ee3-9b56-6d84fde3812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aad0f59-8fff-4ee3-9b56-6d84fde3812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026752735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8b75a44-7493-4a34-bf3b-8489bd9e8da1,host='devstack@QuobyteHD#QuobyteHD',id=668a0140-c157-41fb-bccf-57defa439cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830441873e4749768b3c5940f5153aa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:56Z,use_quota=True,user_id='a3643ff1c6a3407dad0b400a40d53809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5caf1e9-648d-42a9-a38b-cf50d3ef0512),volume_type_id=c5caf1e9-648d-42a9-a38b-cf50d3ef0512)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0616be7c-66b5-44da-a5b4-0fa8bd26b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0616be7c-66b5-44da-a5b4-0fa8bd26b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67815b3-7dc2-4126-ba37-9edbddbb8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67815b3-7dc2-4126-ba37-9edbddbb8727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668a0140-c157-41fb-bccf-57defa439cb8', 'volume_name': 'volume-668a0140-c157-41fb-bccf-57defa439cb8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1401927-a3c2-4c87-9372-65e9eed6426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1401927-a3c2-4c87-9372-65e9eed6426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c9c60f-7c68-4a3f-85fa-78b6014f6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:56 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Volume 668a0140-c157-41fb-bccf-57defa439cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668a0140-c157-41fb-bccf-57defa439cb8', 'volume_size': 1} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8b75a44-7493-4a34-bf3b-8489bd9e8da1,created_at=2026-07-14T18:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026752735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8b75a44-7493-4a34-bf3b-8489bd9e8da1,host='devstack@QuobyteHD#QuobyteHD',id=668a0140-c157-41fb-bccf-57defa439cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830441873e4749768b3c5940f5153aa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:56Z,use_quota=True,user_id='a3643ff1c6a3407dad0b400a40d53809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5caf1e9-648d-42a9-a38b-cf50d3ef0512),volume_type_id=c5caf1e9-648d-42a9-a38b-cf50d3ef0512)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Creating volume 668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:56 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:56 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 1073741824 Jul 14 20:23:56 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:56 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624" returned: 0 in 0.926s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:56 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 Jul 14 20:23:56 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:57 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:57 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:57 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.414s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:23:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3b765c74-16fe-43fb-bb1a-d0352b675117 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Retype volume completed successfully. Jul 14 20:23:57 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" returned: 0 in 0.658s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:57 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2 Jul 14 20:23:57 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:57 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 1073741824" returned: 0 in 0.999s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:57 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:23:57 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:57 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624.fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" returned: 0 in 0.415s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2" released by "_delete_snapshot" :: held 2.889s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" released by "delete_snapshot" :: held 2.915s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['79c764c0-8f1a-4d82-8770-3ae43f24a92e', 'fa99559f-a8f9-4c1d-aa86-a1baaf2f02b4', 'ae079b2e-540c-4bce-a8d0-31078c82fc32', '5f32a3e8-62e2-48ce-a49f-7dabf3803c10'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:58 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.457s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c9c60f-7c68-4a3f-85fa-78b6014f6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668a0140-c157-41fb-bccf-57defa439cb8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b560a-2134-4f82-acfc-757bbca8ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Volume volume-668a0140-c157-41fb-bccf-57defa439cb8 (668a0140-c157-41fb-bccf-57defa439cb8): created successfully Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b560a-2134-4f82-acfc-757bbca8ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Flow 'volume_create_manager' (b6921888-5c32-4fa8-972d-8f0922248223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Delete snapshot completed successfully. Jul 14 20:23:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b0de6e4e-be31-4bac-a018-7b173f421a27 tempest-GroupsV314Test-763983784 None] Created volume successfully. Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8a3b0aa1-02c4-4c81-9f10-13f96ba76577 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-fbeaab3d-cfcf-4371-8aba-64784c5fe1b2-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "cinder-adbda238-d9b0-4fab-8ff0-8507828caeda-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "cinder-adbda238-d9b0-4fab-8ff0-8507828caeda-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "cinder-quobyte-adbda238-d9b0-4fab-8ff0-8507828caeda" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "cinder-quobyte-adbda238-d9b0-4fab-8ff0-8507828caeda" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1297d-0057-4fff-9a05-538cc1b5f164]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:23:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:58 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda Jul 14 20:23:58 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:59 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (72d1d3d8-8de4-4372-8bc6-f23f11654f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be8c9e2-d101-4401-b2d3-0e1fc2d6cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda" returned: 0 in 0.542s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be8c9e2-d101-4401-b2d3-0e1fc2d6cd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-924729360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75072ba8-db09-42ac-a702-3e1645218090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:59Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:59 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230bf9eb-c0f0-47a9-9b31-ce9ac25dff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230bf9eb-c0f0-47a9-9b31-ce9ac25dff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:59 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d602c37-0d91-47a8-8753-9c9885637d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d602c37-0d91-47a8-8753-9c9885637d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75072ba8-db09-42ac-a702-3e1645218090', 'volume_name': 'volume-75072ba8-db09-42ac-a702-3e1645218090', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4800d75-7f79-4655-9147-48ed90c9bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4800d75-7f79-4655-9147-48ed90c9bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee5b7f-6de1-4233-8c7d-bb193bd5e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:23:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Volume 75072ba8-db09-42ac-a702-3e1645218090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75072ba8-db09-42ac-a702-3e1645218090', 'volume_size': 1} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-924729360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75072ba8-db09-42ac-a702-3e1645218090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:23:59Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Creating volume 75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:23:59 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:59 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 1073741824 Jul 14 20:23:59 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:59 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-adbda238-d9b0-4fab-8ff0-8507828caeda" returned: 0 in 0.300s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "cinder-quobyte-adbda238-d9b0-4fab-8ff0-8507828caeda" released by "delete_volume" :: held 0.918s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:23:59 devstack cinder-volume[87600]: WARNING cinder.quota [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:59 devstack cinder-volume[87600]: WARNING cinder.quota [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Created reservations ['a62ecd52-4ac1-478f-bf79-86b695c22e26', '1aa52e87-8c62-49a0-bf85-d24478bfaeef', '7f3db5df-11b5-4143-85d6-e98c05030fc8', 'dd1e6603-9a17-48e0-b2c1-77b9a7cd4cdc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:59 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:23:59 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:23:59 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 1073741824" returned: 0 in 0.510s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:23:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:23:59 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:00 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:00 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Deleted volume successfully. Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f0c6c413-9dcf-48fe-afac-c74effebb706 tempest-VolumeRetypeWithoutMigrationTest-1985948055 None] Lock "cinder-adbda238-d9b0-4fab-8ff0-8507828caeda-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:00 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.230s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:00 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Cloning volume 668a0140-c157-41fb-bccf-57defa439cb8 to volume 75aacfd8-bcc3-4263-9d96-69c6822d7a58 Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee5b7f-6de1-4233-8c7d-bb193bd5e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75072ba8-db09-42ac-a702-3e1645218090', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed79486-7b74-4113-8eb7-486410c62891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Volume volume-75072ba8-db09-42ac-a702-3e1645218090 (75072ba8-db09-42ac-a702-3e1645218090): created successfully Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed79486-7b74-4113-8eb7-486410c62891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (72d1d3d8-8de4-4372-8bc6-f23f11654f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Creating offline snapshot b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa of volume 668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1d75df28-e71f-451c-8e5f-8db0a0acb571 tempest-VolumesSnapshotTestJSON-314302992 None] Created volume successfully. Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db408c-1daf-4903-8a1f-50b34b2c63b2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:00 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:00 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:00 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.351s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:00 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa 1G Jul 14 20:24:00 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:01 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa 1G" returned: 0 in 0.412s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668a0140-c157-41fb-bccf-57defa439cb8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:01 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668a0140-c157-41fb-bccf-57defa439cb8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:01 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:01 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-668a0140-c157-41fb-bccf-57defa439cb8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.344s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:01 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:01 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:01 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:01 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:01 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info Jul 14 20:24:01 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:02 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info" returned: 0 in 0.266s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:02 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:02 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info Jul 14 20:24:02 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:02 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.info" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Acquiring lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] snapshot: b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa, volume: 75aacfd8-bcc3-4263-9d96-69c6822d7a58, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0f34e-eb12-4dcd-8a2e-d179048aafa2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:02 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:02 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:02 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-668a0140-c157-41fb-bccf-57defa439cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a6f6a8-08da-4edb-a7f0-7db114430f42]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:02 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:02 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:03 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.396s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:03 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 Jul 14 20:24:03 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:03 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:03 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:03 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.315s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:24:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:24:08 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58" returned: 0 in 5.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778c1e7-a583-498f-ae33-92499608a742]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:08 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:08 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:09 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.609s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:24:09 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Converted 1024.00 MB image at 193.91 MB/s Jul 14 20:24:09 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:09 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 Jul 14 20:24:09 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:09 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58" returned: 0 in 0.464s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" released by "_copy_volume_from_snapshot" :: held 7.257s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Acquiring lock "cinder-quobyte-b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Deleting offline snapshot b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa of volume 668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] snapshot_file for this snap is: volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca19bde-1efe-4867-9f21-8007e493e3bc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:09 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:09 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:10 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-668a0140-c157-41fb-bccf-57defa439cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdbc56-fc1a-4086-8c74-a744f6255484]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:10 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:10 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:10 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.396s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:10 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:10 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:10 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:10 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa Jul 14 20:24:10 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:11 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8.b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-b9bd2f53-ae99-4c13-9533-b73ea9d4f4fa" released by "_delete_snapshot" :: held 1.538s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.940s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.687s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Creating offline snapshot cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 of volume 75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2baf3-d08e-4c0c-bd9d-122c37d980b7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-22025030-449d-43b5-a91d-6deac9827e5d tempest-GroupsV314Test-763983784 None] Create group from source-group-b8b75a44-7493-4a34-bf3b-8489bd9e8da1 completed successfully. Jul 14 20:24:11 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:11 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:11 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.400s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:11 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 1G Jul 14 20:24:11 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 1G" returned: 0 in 0.489s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75072ba8-db09-42ac-a702-3e1645218090 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:12 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75072ba8-db09-42ac-a702-3e1645218090 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:12 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Acquiring lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037e3cb-9799-47b1-8b4f-b079e5a66f50]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:12 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 Jul 14 20:24:12 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75072ba8-db09-42ac-a702-3e1645218090 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.320s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:12 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 is being set with open permissions: ugo+rw Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:12 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:12 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58" returned: 0 in 0.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:12 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58 Jul 14 20:24:12 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:12 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info Jul 14 20:24:12 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:12 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75aacfd8-bcc3-4263-9d96-69c6822d7a58" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-75aacfd8-bcc3-4263-9d96-69c6822d7a58" released by "delete_volume" :: held 0.710s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:12 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Created reservations ['1a95e72f-056c-4382-b49e-bd2e3b929ed2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:13 devstack cinder-volume[87600]: WARNING cinder.quota [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1916881316 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1916881316, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:13 devstack cinder-volume[87600]: WARNING cinder.quota [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1916881316 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1916881316, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Created reservations ['eabaa295-4383-48e5-9e77-3f18bb44f3e9', '0cd860ec-3907-4244-983c-6f22658be915', '2d627370-fc77-4025-a142-cbf66aaba220', '761b6034-0480-43d1-9f37-cd88fa14ab14'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:13 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info" returned: 0 in 0.310s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:13 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info is being set with open permissions: ugo+rw Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:13 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info Jul 14 20:24:13 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:13 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:13 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:13 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.info" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.469s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fed493-7feb-41e4-92c3-7cc618b8c3d8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-caa84092-8c48-48ba-868c-fef0dfdbe01d tempest-VolumesSnapshotTestJSON-314302992 None] Create snapshot completed successfully Jul 14 20:24:13 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-56bd0c03-dd4c-4d9c-94b8-1f8fa2689faf tempest-GroupsV314Test-763983784 None] Delete group completed successfully. Jul 14 20:24:13 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a Jul 14 20:24:13 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:13 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.404s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c8989be-feb3-413e-9071-2e9f827be640', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Acquiring lock "cinder-quobyte-668a0140-c157-41fb-bccf-57defa439cb8" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-668a0140-c157-41fb-bccf-57defa439cb8" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-c4445533-8b45-4afe-ad1d-36ba7ce5ed9b req-8014a313-859b-4412-82a3-9555a256e003 tempest-TestInstancesWithCinderVolumes-401153744 None] attachment_update completed successfully. Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f31ddd4-7085-4fc8-96e5-d2d1e96ad6d6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:14 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:14 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:14 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.501s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:14 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8 Jul 14 20:24:14 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:14 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-668a0140-c157-41fb-bccf-57defa439cb8" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Lock "cinder-quobyte-668a0140-c157-41fb-bccf-57defa439cb8" released by "delete_volume" :: held 0.916s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Created reservations ['72ab7f08-a07d-41eb-8437-2967285eaea1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (b345dfe7-e27d-459f-9822-aed06dc0e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b4fdbb-6aa7-4396-8733-c6ce07eca788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b4fdbb-6aa7-4396-8733-c6ce07eca788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2017011536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fee169c-4cd4-414d-8e82-e354b866c279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:15Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a6807c-60b6-40e6-b910-a57a235e84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a6807c-60b6-40e6-b910-a57a235e84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a196c49-3761-44d7-a325-8604ce70bbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a196c49-3761-44d7-a325-8604ce70bbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fee169c-4cd4-414d-8e82-e354b866c279', 'volume_name': 'volume-7fee169c-4cd4-414d-8e82-e354b866c279', 'volume_size': 2, 'snapshot_id': 'cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05adeea3-62a9-4bec-a41b-977c3171ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05adeea3-62a9-4bec-a41b-977c3171ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869bed0c-4728-48f6-beef-7a8b866ebb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Volume 7fee169c-4cd4-414d-8e82-e354b866c279: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fee169c-4cd4-414d-8e82-e354b866c279', 'volume_size': 2, 'snapshot_id': 'cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1'} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-7fee169c-4cd4-414d-8e82-e354b866c279" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-7fee169c-4cd4-414d-8e82-e354b866c279" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Creating volume 7fee169c-4cd4-414d-8e82-e354b866c279 from snapshot cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Created reservations ['d8c1a50e-11ef-47ea-840e-e2bbe87d5a72', '6f98913e-f196-45bc-83f5-73ff5e605ced', '68ca8bcd-cf71-4712-a892-2ecfcb673fb3', '1b664ed5-7296-4616-bf5b-a4170f64f105'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] snapshot: cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1, volume: 7fee169c-4cd4-414d-8e82-e354b866c279, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3e20f5-6003-49b5-b7b8-39335ee4061c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:15 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:15 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:15 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:15 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:15 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-74f359ac-3866-4a27-acf0-280d46a7c72c tempest-GroupsV314Test-763983784 None] Delete group completed successfully. Jul 14 20:24:15 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.451s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75072ba8-db09-42ac-a702-3e1645218090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399d414-41dc-49d2-aae1-3bc60c797c08]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:15 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:15 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:16 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.472s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:16 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:24:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:16 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 Jul 14 20:24:16 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:21 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279" returned: 0 in 5.475s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3904df2b-61bb-4a6c-a2b7-f972010640af]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:21 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:21 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:22 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.600s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:24:22 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Converted 1024.00 MB image at 187.00 MB/s Jul 14 20:24:22 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 is being set with open permissions: ugo+rw Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:22 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 Jul 14 20:24:22 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:22 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279" returned: 0 in 0.269s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" released by "_copy_volume_from_snapshot" :: held 7.412s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-7fee169c-4cd4-414d-8e82-e354b866c279" released by "_create_volume_from_snapshot" :: held 7.465s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.493s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.019s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43aa18-d08a-46e8-bad0-168f3848cd75]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869bed0c-4728-48f6-beef-7a8b866ebb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fee169c-4cd4-414d-8e82-e354b866c279', 'volume_size': 2, 'snapshot_id': 'cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307c4482-6652-4646-bc5c-06427b235ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Volume volume-7fee169c-4cd4-414d-8e82-e354b866c279 (7fee169c-4cd4-414d-8e82-e354b866c279): created successfully Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307c4482-6652-4646-bc5c-06427b235ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (b345dfe7-e27d-459f-9822-aed06dc0e47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5b7c1516-5be7-43c5-bc7e-633aa864b249 tempest-VolumesSnapshotTestJSON-314302992 None] Created volume successfully. Jul 14 20:24:22 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 Jul 14 20:24:22 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-7fee169c-4cd4-414d-8e82-e354b866c279-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-7fee169c-4cd4-414d-8e82-e354b866c279-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:23 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0" returned: 0 in 0.485s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.518s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71288de-cf1f-4b69-b253-a11c47d5c83c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-3179901d-f333-471e-9f4e-53389bb74fb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3b3ce74-fa19-4d13-98ae-52f505ca9953', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:24:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-213198c2-7129-429b-98ab-1e41952244a2 req-da663756-aa92-42b0-b8f5-cfed37dab91f tempest-TestInstancesWithCinderVolumes-401153744 None] attachment_update completed successfully. Jul 14 20:24:23 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 Jul 14 20:24:23 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:23 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279" returned: 0 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:23 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279 Jul 14 20:24:23 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:23 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7fee169c-4cd4-414d-8e82-e354b866c279" returned: 0 in 0.321s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-7fee169c-4cd4-414d-8e82-e354b866c279" released by "delete_volume" :: held 0.837s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=150,cinder:INSERT=47,cinder:UPDATE=169,cinder:DELETE=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:24:23 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:INSERT=31,cinder:UPDATE=143,cinder:SELECT=172,cinder:DELETE=8 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['7bc551ae-baa5-429e-82a9-406317fa6a91', '50192520-0c47-48fe-a5ef-7bfd86cb798c', 'd247a639-4f8e-4650-a40c-b349123a643c', '50334371-a70e-4e77-9ded-f3f38560f07b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:24 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:24 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:24 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Deleting offline snapshot cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 of volume 75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] snapshot_file for this snap is: volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.344s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Deleted volume successfully. Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb828f8a-96fb-4d80-a259-c879648b61c2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8b14dec6-4a3c-474c-affa-7da6280e1621 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-7fee169c-4cd4-414d-8e82-e354b866c279-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:24 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:24 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:24 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.484s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75072ba8-db09-42ac-a702-3e1645218090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c916e4-76d8-4bc3-9a28-56112086fbf0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:25 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:25 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:25 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:25 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:25 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:25 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.451s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:25 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1 Jul 14 20:24:25 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:26 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090.cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Flow 'volume_create_manager' (0de02a9e-043f-476f-8b9a-dd425f14491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efe9df7-e79e-45b6-af90-de1442c1c332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1" released by "_delete_snapshot" :: held 2.010s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efe9df7-e79e-45b6-af90-de1442c1c332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-345827274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23260cf4-9d4b-4ea6-a49b-8f476208e5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f3352de514ac4a6ec75c1fa8395d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:26Z,use_quota=True,user_id='0190c1b2a8894c98805b48e018eff8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbcac92-fbdd-447c-a65e-32fcc4f5b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbcac92-fbdd-447c-a65e-32fcc4f5b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c1be6f-a1cf-4bf1-856f-c968deef0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c1be6f-a1cf-4bf1-856f-c968deef0bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23260cf4-9d4b-4ea6-a49b-8f476208e5c5', 'volume_name': 'volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d37502f-3579-40f6-8877-10e350a6b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d37502f-3579-40f6-8877-10e350a6b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2481e1a2-7e0b-4937-8279-d60a223b20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5', 'volume_size': 1} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-345827274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23260cf4-9d4b-4ea6-a49b-8f476208e5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f3352de514ac4a6ec75c1fa8395d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:26Z,use_quota=True,user_id='0190c1b2a8894c98805b48e018eff8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Creating volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:26 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" released by "delete_snapshot" :: held 2.113s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:26 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 1073741824 Jul 14 20:24:26 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['6823e0a5-0aa1-4508-8bdf-5d02afec7289', '3d91243c-7d51-423c-991f-09b330bdceea', 'a6de9d92-7fb8-40d9-a68f-5f265e75b205', 'bc4c5d3b-2dc3-4d1c-9f21-b53e4b513f72'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Delete snapshot completed successfully. Jul 14 20:24:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-79befac2-ad18-4623-931d-f259b395c28d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-cac50780-8fb7-4aa1-b9f2-8aa0ebcf11f1-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:27 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 1073741824" returned: 0 in 0.578s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:27 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 Jul 14 20:24:27 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:27 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2481e1a2-7e0b-4937-8279-d60a223b20ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe9ae8-c267-4956-a3a8-7775c71fe771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Volume volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 (23260cf4-9d4b-4ea6-a49b-8f476208e5c5): created successfully Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe9ae8-c267-4956-a3a8-7775c71fe771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Flow 'volume_create_manager' (0de02a9e-043f-476f-8b9a-dd425f14491d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bf053602-2403-4310-88fc-add265d24080 tempest-SnapshotsActionsTest-1912045070 None] Created volume successfully. Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-75072ba8-db09-42ac-a702-3e1645218090-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-75072ba8-db09-42ac-a702-3e1645218090-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[01befb80-dacf-4bdb-9ba4-9b9d041c9197]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:27 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:27 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:28 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.414s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:28 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090 Jul 14 20:24:28 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:28 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-75072ba8-db09-42ac-a702-3e1645218090" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-75072ba8-db09-42ac-a702-3e1645218090" released by "delete_volume" :: held 0.779s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['0b691e87-e82c-4642-aee2-092b912fa368', '82c36268-cc5b-478f-b0d0-cb400aabf12a', '7e2e5598-8345-4589-881e-a1591a714d1f', '5c82aadf-1eea-4a62-8d4d-5af269803c21'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Creating offline snapshot 7dca8e43-8932-4ad8-8558-e06739fa35a4 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c65785-12e3-4285-821d-b80520b9895f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:28 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:28 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:28 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 Jul 14 20:24:28 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:29 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Deleted volume successfully. Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6cd61dab-2931-45b0-8ff7-50969453184d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-75072ba8-db09-42ac-a702-3e1645218090-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-64792175-368d-4ea1-bbdc-3fe8d0158935 req-784b2d2e-850d-433d-9d72-fe3c5e6165f2 tempest-TestInstancesWithCinderVolumes-401153744 None] Terminate volume connection completed successfully. Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-64792175-368d-4ea1-bbdc-3fe8d0158935 req-784b2d2e-850d-433d-9d72-fe3c5e6165f2 tempest-TestInstancesWithCinderVolumes-401153744 None] Deleting attachment 5c8989be-feb3-413e-9071-2e9f827be640. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:24:29 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" returned: 0 in 0.627s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:29 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 1G Jul 14 20:24:29 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (3ffb3ba1-ca3a-404c-852c-6f49c91423d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5975e2f7-c053-4383-b4a4-d83eec20efcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5975e2f7-c053-4383-b4a4-d83eec20efcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1999787179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:30Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a91cfa2-96a5-4fe8-b36b-6958d1b6ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a91cfa2-96a5-4fe8-b36b-6958d1b6ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54cee06-44b6-4f7e-98b2-4b3755c6aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54cee06-44b6-4f7e-98b2-4b3755c6aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0', 'volume_name': 'volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcef0d0d-cd92-4584-a0f6-67b573b9081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcef0d0d-cd92-4584-a0f6-67b573b9081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde7717-ca49-4e17-ad77-ecefcc0e2f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Volume 3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0', 'volume_size': 1} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:29 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 1G" returned: 0 in 0.518s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:29 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:29 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-66a3f51e-f2da-4045-89d9-2ed7133ed36a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-66a3f51e-f2da-4045-89d9-2ed7133ed36a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-quobyte-66a3f51e-f2da-4045-89d9-2ed7133ed36a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-66a3f51e-f2da-4045-89d9-2ed7133ed36a" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[76671fbc-261d-4957-b69f-777c35ad7234]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:30 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a Jul 14 20:24:30 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:30 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:30 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 is being set with open permissions: ugo+rw Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:30 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:30 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:30 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:30 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a Jul 14 20:24:30 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:30 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.311s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:30 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info Jul 14 20:24:30 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:30 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66a3f51e-f2da-4045-89d9-2ed7133ed36a" returned: 0 in 0.331s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-66a3f51e-f2da-4045-89d9-2ed7133ed36a" released by "delete_volume" :: held 0.792s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:30 devstack cinder-volume[87600]: WARNING cinder.quota [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246179486-2098572270 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246179486-2098572270, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:30 devstack cinder-volume[87600]: WARNING cinder.quota [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246179486-2098572270 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1246179486-2098572270, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Created reservations ['10da9753-478b-4e4e-a124-92c243250d4a', '3a594b45-fd87-4ba7-bcc8-f57a0d06e6b3', '1303b2dc-fc17-4b68-9871-a7be01eacfcf', '9df220ed-5f50-4e1b-ace0-0c1ecb182d24'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:31 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:31 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info is being set with open permissions: ugo+rw Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:31 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:31 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:31 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info Jul 14 20:24:31 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (60467114-1189-4cd6-b98e-60544e329b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b351dada-55a3-411c-9a92-4cc3564b4b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b351dada-55a3-411c-9a92-4cc3564b4b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-144091685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fff392b-3cd2-49df-9a26-a9a4348187e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:31Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661b6e6a-587d-4607-8743-7fcad73d1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661b6e6a-587d-4607-8743-7fcad73d1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9df4ec-2a12-49e8-8426-da999bf2bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9df4ec-2a12-49e8-8426-da999bf2bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fff392b-3cd2-49df-9a26-a9a4348187e7', 'volume_name': 'volume-5fff392b-3cd2-49df-9a26-a9a4348187e7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe70306-cabe-4fc5-b945-4c80edfd16bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe70306-cabe-4fc5-b945-4c80edfd16bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ef3b9e-273f-4755-85de-194089940b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:31 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Volume 5fff392b-3cd2-49df-9a26-a9a4348187e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fff392b-3cd2-49df-9a26-a9a4348187e7', 'volume_size': 1} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:31 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Deleted volume successfully. Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bda9b0c1-e029-456d-b0b2-62500c6532fa tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-66a3f51e-f2da-4045-89d9-2ed7133ed36a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:31 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.info" returned: 0 in 0.328s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1999787179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:30Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Creating volume 3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:31 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:31 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 1073741824 Jul 14 20:24:31 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e0c6d73c-a7e4-4a24-b84d-8ef10a3c7e8e tempest-SnapshotsActionsTest-1912045070 None] Create snapshot completed successfully Jul 14 20:24:31 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 1073741824" returned: 0 in 0.484s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:31 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:31 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:32 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-144091685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fff392b-3cd2-49df-9a26-a9a4348187e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:31Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Creating volume 5fff392b-3cd2-49df-9a26-a9a4348187e7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:32 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:32 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 1073741824 Jul 14 20:24:32 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde7717-ca49-4e17-ad77-ecefcc0e2f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5dcba4-9ce8-4185-8a67-b50dc1a14557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Volume volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 (3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0): created successfully Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5dcba4-9ce8-4185-8a67-b50dc1a14557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (3ffb3ba1-ca3a-404c-852c-6f49c91423d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-06531b38-a427-4fdf-9bf0-c5e925f4da10 tempest-VolumesSnapshotTestJSON-314302992 None] Created volume successfully. Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:32 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 1073741824" returned: 0 in 0.511s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:32 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 Jul 14 20:24:32 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:33 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.493s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ef3b9e-273f-4755-85de-194089940b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fff392b-3cd2-49df-9a26-a9a4348187e7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89775c70-e1aa-4638-8cfb-5a4cfd1a8bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Creating offline snapshot 02cff41b-edc9-4d04-946c-0671982ee209 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:33 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Volume volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 (5fff392b-3cd2-49df-9a26-a9a4348187e7): created successfully Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89775c70-e1aa-4638-8cfb-5a4cfd1a8bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (60467114-1189-4cd6-b98e-60544e329b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34ec8b-f598-484c-82fd-c84332c54743]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4f13f4d1-63f2-4864-86f2-fa225e5cee85 tempest-VolumesListAdminTestJSON-147452247 None] Created volume successfully. Jul 14 20:24:33 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:33 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:33 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.371s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:33 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 1G Jul 14 20:24:33 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:33 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 1G" returned: 0 in 0.420s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:33 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 Jul 14 20:24:33 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-fc06d4c2-5485-4ee9-92c2-9990b4ed5fd0 req-76aad449-1b8c-4981-9cfb-924acbedc616 tempest-TestInstancesWithCinderVolumes-401153744 None] Terminate volume connection completed successfully. Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-fc06d4c2-5485-4ee9-92c2-9990b4ed5fd0 req-76aad449-1b8c-4981-9cfb-924acbedc616 tempest-TestInstancesWithCinderVolumes-401153744 None] Deleting attachment e3b3ce74-fa19-4d13-98ae-52f505ca9953. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:24:34 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:34 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 is being set with open permissions: ugo+rw Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:34 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 Jul 14 20:24:34 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:34 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.492s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.523s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Creating offline snapshot 3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 of volume 3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-409fbc1e-1348-44f3-9608-66c9268ae00f tempest-SnapshotsActionsTest-1912045070 None] Create snapshot completed successfully Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[55684396-d9b5-40b2-b02a-dc6a6f302dba]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:34 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:34 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-3179901d-f333-471e-9f4e-53389bb74fb0-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-3179901d-f333-471e-9f4e-53389bb74fb0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (f18d21c6-7fac-42b9-ae68-8e9578397409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd6213-dfed-4277-a9ab-23fe33c53524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-02cff41b-edc9-4d04-946c-0671982ee209-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-quobyte-3179901d-f333-471e-9f4e-53389bb74fb0" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd6213-dfed-4277-a9ab-23fe33c53524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2028402721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9609fc95-901e-473c-b16e-124b16671e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:35Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c8e69c-3fdc-46a7-a292-a3c401641f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c8e69c-3fdc-46a7-a292-a3c401641f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec17cca7-281c-4766-a8f9-a9207ebcc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec17cca7-281c-4766-a8f9-a9207ebcc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9609fc95-901e-473c-b16e-124b16671e4e', 'volume_name': 'volume-9609fc95-901e-473c-b16e-124b16671e4e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc22ab9-7ad4-4fe9-b6f9-42c138bdd95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc22ab9-7ad4-4fe9-b6f9-42c138bdd95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1465920e-6a02-4092-91e4-394c97a7034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:34 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Volume 9609fc95-901e-473c-b16e-124b16671e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9609fc95-901e-473c-b16e-124b16671e4e', 'volume_size': 1} Jul 14 20:24:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-02cff41b-edc9-4d04-946c-0671982ee209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-3179901d-f333-471e-9f4e-53389bb74fb0" acquired by "delete_volume" :: waited 0.067s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-02cff41b-edc9-4d04-946c-0671982ee209" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3820efd8-67af-4ddf-a0c2-7aefde0e3cef]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-02cff41b-edc9-4d04-946c-0671982ee209" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Deleting offline snapshot 02cff41b-edc9-4d04-946c-0671982ee209 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:35 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] snapshot_file for this snap is: volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.516s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba3ddc-01ee-4c5a-bf08-d78f6465a99f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 1G Jul 14 20:24:35 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 Jul 14 20:24:35 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 Jul 14 20:24:35 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0" returned: 0 in 0.448s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0 Jul 14 20:24:35 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209" returned: 0 in 0.442s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:35 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 1G" returned: 0 in 0.488s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b781a8e-0113-43a2-a0ec-0336e53830b4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:35 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:35 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:35 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:35 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3179901d-f333-471e-9f4e-53389bb74fb0" returned: 0 in 0.299s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-3179901d-f333-471e-9f4e-53389bb74fb0" released by "delete_volume" :: held 0.811s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:35 devstack cinder-volume[87600]: WARNING cinder.quota [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497835655-372574237 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497835655-372574237, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:35 devstack cinder-volume[87600]: WARNING cinder.quota [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497835655-372574237 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-497835655-372574237, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Created reservations ['337f328a-882b-4a77-b2f0-51c305a88138', '2495c96e-dfd9-4dc3-9be1-14890c72aed1', '96f40879-176f-4630-bab4-59c451009c82', 'f9ceb573-09f6-4722-b789-46616df20099'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:35 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:35 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 is being set with open permissions: ugo+rw Jul 14 20:24:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:36 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:36 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:36 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:36 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 Jul 14 20:24:36 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:36 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.298s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Deleted volume successfully. Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66c1fe1c-097d-4f53-b5fb-f3d0e0066092 tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-3179901d-f333-471e-9f4e-53389bb74fb0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:36 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info Jul 14 20:24:36 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:36 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209" returned: 0 in 0.586s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209 Jul 14 20:24:36 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:36 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:36 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info is being set with open permissions: ugo+rw Jul 14 20:24:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:36 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info Jul 14 20:24:36 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:37 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.02cff41b-edc9-4d04-946c-0671982ee209" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-02cff41b-edc9-4d04-946c-0671982ee209" released by "_delete_snapshot" :: held 1.968s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_snapshot" :: held 2.012s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:37 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.info" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2028402721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9609fc95-901e-473c-b16e-124b16671e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:35Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Creating volume 9609fc95-901e-473c-b16e-124b16671e4e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:37 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:37 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e 1073741824 Jul 14 20:24:37 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a60d1abc-71b7-462f-af75-67315ed42deb tempest-VolumesSnapshotTestJSON-314302992 None] Create snapshot completed successfully Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Created reservations ['472f4b9a-fe3b-4451-bd22-c7853bd89759', 'a658e4a3-1c55-4da2-84f1-cecf5bf69784', '6c85bd30-c4a3-49fc-98a6-b99d1fa28fc9', 'f8169aae-8a0d-4061-8cb4-096d2fa348de'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Delete snapshot completed successfully. Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cfe1370c-d06d-4b95-9f13-3883e045ecb9 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-02cff41b-edc9-4d04-946c-0671982ee209-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:37 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e 1073741824" returned: 0 in 0.656s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:37 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e Jul 14 20:24:37 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (3f270f28-3980-47d4-b96d-5e11197ca9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9886ee28-b9a4-446a-b737-71e2eef60b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9886ee28-b9a4-446a-b737-71e2eef60b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1514692813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e74a25-acf7-40d9-82f7-b20e3879bed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962100782ec24f63b6b0f1f06f1d4a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fff4f1d-7311-4fd7-a8df-e418c0bb3e88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:38Z,use_quota=True,user_id='6f72387dd25d41b6a9758ca057f3a31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc15e5b-9f65-4666-9649-dfea9144ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc15e5b-9f65-4666-9649-dfea9144ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb30979-5cd4-4c88-9fe6-cdbbb1fb3c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb30979-5cd4-4c88-9fe6-cdbbb1fb3c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6e74a25-acf7-40d9-82f7-b20e3879bed5', 'volume_name': 'volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5', 'volume_size': 1, 'snapshot_id': '3fff4f1d-7311-4fd7-a8df-e418c0bb3e88'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494816d8-4064-4bcf-945b-3a5ed92138e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494816d8-4064-4bcf-945b-3a5ed92138e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461528d4-62b8-4349-aa55-e28858bc108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Volume f6e74a25-acf7-40d9-82f7-b20e3879bed5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5', 'volume_size': 1, 'snapshot_id': '3fff4f1d-7311-4fd7-a8df-e418c0bb3e88'} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e" returned: 0 in 0.589s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-f6e74a25-acf7-40d9-82f7-b20e3879bed5" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1465920e-6a02-4092-91e4-394c97a7034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9609fc95-901e-473c-b16e-124b16671e4e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b043470d-8dd8-4513-8e52-d9e1186563b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-f6e74a25-acf7-40d9-82f7-b20e3879bed5" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Creating volume f6e74a25-acf7-40d9-82f7-b20e3879bed5 from snapshot 3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:38 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Volume volume-9609fc95-901e-473c-b16e-124b16671e4e (9609fc95-901e-473c-b16e-124b16671e4e): created successfully Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b043470d-8dd8-4513-8e52-d9e1186563b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (f18d21c6-7fac-42b9-ae68-8e9578397409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] snapshot: 3fff4f1d-7311-4fd7-a8df-e418c0bb3e88, volume: f6e74a25-acf7-40d9-82f7-b20e3879bed5, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:24:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0786c331-17ca-4145-8d5d-ac6789de6ac7 tempest-VolumesListAdminTestJSON-147452247 None] Created volume successfully. Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[20600dcf-4006-4c77-8b6a-abee719afe47]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:38 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:38 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:39 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.485s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[afebcd4e-477c-402c-aad8-7d2b58bf7547]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:39 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:39 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-8a7610ae-6d6d-4fe1-bf02-12b78462ee80 req-f4225ee4-bc64-42f3-857d-5d2c1fafc810 tempest-TestInstancesWithCinderVolumes-401153744 None] Terminate volume connection completed successfully. Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-8a7610ae-6d6d-4fe1-bf02-12b78462ee80 req-f4225ee4-bc64-42f3-857d-5d2c1fafc810 tempest-TestInstancesWithCinderVolumes-401153744 None] Deleting attachment 672b705b-e2da-4155-bd59-edc49686f870. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:24:39 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:39 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 Jul 14 20:24:39 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (04d441dc-007b-4d7b-b84a-5142a72ee901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a85f621-6593-4798-84e8-3ae27ceae953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a85f621-6593-4798-84e8-3ae27ceae953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-36104878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2e2056-4402-48b2-9999-c87d56ab1502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:40Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3707424-5f84-47f3-a9a3-450286e60789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3707424-5f84-47f3-a9a3-450286e60789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b135f54-2a5f-416b-8827-8fd9afc8b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b135f54-2a5f-416b-8827-8fd9afc8b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2e2056-4402-48b2-9999-c87d56ab1502', 'volume_name': 'volume-cf2e2056-4402-48b2-9999-c87d56ab1502', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961abb04-7ddb-4354-afc6-f55c08de45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961abb04-7ddb-4354-afc6-f55c08de45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253bf670-bcc2-4276-8717-9f14a607cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:39 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Volume cf2e2056-4402-48b2-9999-c87d56ab1502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2e2056-4402-48b2-9999-c87d56ab1502', 'volume_size': 1} Jul 14 20:24:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-7f81c36a-a595-46b6-b197-cae992038506-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-7f81c36a-a595-46b6-b197-cae992038506-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "cinder-quobyte-7f81c36a-a595-46b6-b197-cae992038506" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-7f81c36a-a595-46b6-b197-cae992038506" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[29153e7e-dd1e-42e3-a338-7ddd8d5732f4]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:41 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:24:41 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:41 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 0.605s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:41 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:24:41 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:42 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 1 in 0.679s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:24:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:42 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506 Jul 14 20:24:42 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:42 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7f81c36a-a595-46b6-b197-cae992038506" returned: 0 in 0.573s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-quobyte-7f81c36a-a595-46b6-b197-cae992038506" released by "delete_volume" :: held 2.007s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:43 devstack cinder-volume[87600]: WARNING cinder.quota [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1878029335-812679201 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1878029335-812679201, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:43 devstack cinder-volume[87600]: WARNING cinder.quota [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1878029335-812679201 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1878029335-812679201, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Created reservations ['dff1eedc-521b-494b-8aaa-111560092019', '37a687c6-74fc-4d87-ac9d-cfa3e09183c2', '22910a99-eb36-4667-9fd9-b683f0ac57c8', '26303b3b-5171-423b-88c4-c20f332db052'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:43 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:43 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:43 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.391s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Deleted volume successfully. Jul 14 20:24:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-32a39118-5538-4690-a947-c7ce3b61729f tempest-TestInstancesWithCinderVolumes-401153744 None] Lock "cinder-7f81c36a-a595-46b6-b197-cae992038506-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:44 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5" returned: 0 in 4.770s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c7dbd-a404-4874-af5d-059f08aee766]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:44 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:44 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:45 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.548s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:24:45 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Converted 1024.00 MB image at 214.62 MB/s Jul 14 20:24:45 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 is being set with open permissions: ugo+rw Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:45 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 Jul 14 20:24:45 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:45 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5" returned: 0 in 0.240s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" released by "_copy_volume_from_snapshot" :: held 6.740s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-f6e74a25-acf7-40d9-82f7-b20e3879bed5" released by "_create_volume_from_snapshot" :: held 6.837s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.899s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.542s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Creating offline snapshot 2926bdc9-4d58-45b1-a97c-f5b52e534a49 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461528d4-62b8-4349-aa55-e28858bc108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5', 'volume_size': 1, 'snapshot_id': '3fff4f1d-7311-4fd7-a8df-e418c0bb3e88'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f7f036-f4c4-4f46-b6a9-f7b998f698e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80db3d-7d0e-4fc8-96d7-49235611a941]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Volume volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 (f6e74a25-acf7-40d9-82f7-b20e3879bed5): created successfully Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f7f036-f4c4-4f46-b6a9-f7b998f698e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Flow 'volume_create_manager' (3f270f28-3980-47d4-b96d-5e11197ca9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-226ed990-efab-48b4-be14-bedafcfa05d4 tempest-VolumesSnapshotTestJSON-314302992 None] Created volume successfully. Jul 14 20:24:45 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:45 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-f6e74a25-acf7-40d9-82f7-b20e3879bed5-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-f6e74a25-acf7-40d9-82f7-b20e3879bed5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[077cbe6c-92a9-4ffb-9895-79f89ecfeedd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:45 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.473s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:45 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 1G Jul 14 20:24:45 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:45 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 Jul 14 20:24:45 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:46 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5" returned: 0 in 0.405s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:46 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5 Jul 14 20:24:46 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:46 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 1G" returned: 0 in 0.464s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:46 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 Jul 14 20:24:46 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:46 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f6e74a25-acf7-40d9-82f7-b20e3879bed5" returned: 0 in 0.273s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-f6e74a25-acf7-40d9-82f7-b20e3879bed5" released by "delete_volume" :: held 0.724s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['61bbec0a-2697-459a-ab9c-01101328a76e', '751a3da9-6fcf-4a55-8ab2-0c00c27bc5e9', 'b85b27c8-977d-41cd-90a3-d2914c2b5f89', 'fd86e193-b88c-4119-ae14-dad0d02417e6'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:46 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:46 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 is being set with open permissions: ugo+rw Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:46 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 Jul 14 20:24:46 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:46 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:46 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:47 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49" returned: 0 in 0.326s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:47 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.301s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Deleting offline snapshot 3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 of volume 3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] snapshot_file for this snap is: volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:47 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Deleted volume successfully. Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8952e7-3bc0-45e4-9de9-dd4592600850]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.128s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-36104878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2e2056-4402-48b2-9999-c87d56ab1502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b846fe7c794d9ba31c5e507bdac039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:40Z,use_quota=True,user_id='4d52caf7d4504ff79b6b3c3f0898333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Creating volume cf2e2056-4402-48b2-9999-c87d56ab1502 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:47 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:47 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 1073741824 Jul 14 20:24:47 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-551ed8c8-9313-4680-92a4-9356f31df4d7 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-f6e74a25-acf7-40d9-82f7-b20e3879bed5-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:47 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6b3f7c2d-7027-4278-8b10-9dabc07b9f1c tempest-SnapshotsActionsTest-1912045070 None] Create snapshot completed successfully Jul 14 20:24:47 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:47 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-2926bdc9-4d58-45b1-a97c-f5b52e534a49-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:47 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.364s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-2926bdc9-4d58-45b1-a97c-f5b52e534a49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f76f5c-8e57-47df-b99b-16db534b46e4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-2926bdc9-4d58-45b1-a97c-f5b52e534a49" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-2926bdc9-4d58-45b1-a97c-f5b52e534a49" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Deleting offline snapshot 2926bdc9-4d58-45b1-a97c-f5b52e534a49 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] snapshot_file for this snap is: volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8741c799-f80b-4db4-a2b4-48fed40e3390]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:47 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:47 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:47 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 1073741824" returned: 0 in 0.561s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:47 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 Jul 14 20:24:47 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:47 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 Jul 14 20:24:47 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:47 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.434s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:48 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:48 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:48 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49" returned: 0 in 0.443s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:48 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502" returned: 0 in 0.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42aa083-f1a7-4591-8a17-2c6aa12e6d1b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253bf670-bcc2-4276-8717-9f14a607cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2e2056-4402-48b2-9999-c87d56ab1502', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0c67b1-efb4-4b3a-aeec-9a347d862ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Volume volume-cf2e2056-4402-48b2-9999-c87d56ab1502 (cf2e2056-4402-48b2-9999-c87d56ab1502): created successfully Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0c67b1-efb4-4b3a-aeec-9a347d862ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Flow 'volume_create_manager' (04d441dc-007b-4d7b-b84a-5142a72ee901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3dfd4e7d-2bc0-4029-9ab3-577cf9583a1f tempest-VolumesListAdminTestJSON-147452247 None] Created volume successfully. Jul 14 20:24:48 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:48 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:48 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.513s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:48 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88 Jul 14 20:24:48 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:48 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:48 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 Jul 14 20:24:48 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:48 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0.3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" returned: 0 in 0.281s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88" released by "_delete_snapshot" :: held 1.797s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" released by "delete_snapshot" :: held 1.827s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:48 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['bc8c0ce9-73eb-4a67-970f-15f885e997c2', '6401c124-41f8-4107-a841-025e3291127a', 'b620d70f-4b47-4715-9051-e028e4b7044a', '68839335-2b39-419b-845a-8b1becfe7577'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Delete snapshot completed successfully. Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-263f2c4c-60da-4a06-82b1-80a8714a087d tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-3fff4f1d-7311-4fd7-a8df-e418c0bb3e88-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:49 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49" returned: 0 in 0.517s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:49 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49 Jul 14 20:24:49 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[56971aa2-d712-4511-89fc-b37b3f87b61c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:49 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.2926bdc9-4d58-45b1-a97c-f5b52e534a49" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-2926bdc9-4d58-45b1-a97c-f5b52e534a49" released by "_delete_snapshot" :: held 1.986s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_snapshot" :: held 2.051s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:49 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:49 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Flow 'volume_create_manager' (8bab21b5-d941-4933-8841-9c380284d42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c60aef2-b5f3-42f2-a983-9c89b5c86e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c60aef2-b5f3-42f2-a983-9c89b5c86e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd8f6e0b8b491794cd5d1d2d881136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:50Z,use_quota=True,user_id='2a70fc227690487aa7c98ac1e946ed15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e5b446-34da-4aab-86ba-dda0e77d2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e5b446-34da-4aab-86ba-dda0e77d2281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc6a6c0-ee77-4943-9744-a1579b5a18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc6a6c0-ee77-4943-9744-a1579b5a18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6', 'volume_name': 'volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ba0f4b-ff95-47a8-b691-d27b0452f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ba0f4b-ff95-47a8-b691-d27b0452f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda466d6-3ff2-4685-b9a0-d1c62c37e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Volume b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6', 'volume_size': 1} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efd8f6e0b8b491794cd5d1d2d881136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:24:50Z,use_quota=True,user_id='2a70fc227690487aa7c98ac1e946ed15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Creating volume b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:24:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Created reservations ['b265ab92-fdb3-4f9f-a164-2c296f1c4e12', '688cdf2b-f480-4250-a2a0-c9da8e7a852b', 'bb30038d-759d-48c7-9b6c-6a057cc3c34e', '974e1ccf-2616-4093-9c86-2a93cc294da2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:49 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 1073741824 Jul 14 20:24:49 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Delete snapshot completed successfully. Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c09b3bc3-0e20-4d37-b7e0-416cfc15ef44 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-2926bdc9-4d58-45b1-a97c-f5b52e534a49-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:49 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:49 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0 Jul 14 20:24:49 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:50 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0" released by "delete_volume" :: held 0.823s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['48f143f9-ff26-4246-93ba-fdbf2d8cb4ae', '737c813c-2686-4d12-9654-9ccf70b501c0', '8980d5c9-2780-47b6-91ee-f4953a8e25fa', '249a5e27-6fdc-47ba-9eb4-0c605e120359'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:50 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 1073741824" returned: 0 in 0.538s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:50 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 Jul 14 20:24:50 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:50 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:50 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-b5184b0e-2a1a-4115-9204-f866111d1624-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-b5184b0e-2a1a-4115-9204-f866111d1624-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" acquired by "delete_volume" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:50 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" returned: 0 in 0.385s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:50 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.347s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5138eb-dd9f-4fb7-8ef9-f21e97040e5d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Deleted volume successfully. Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda466d6-3ff2-4685-b9a0-d1c62c37e52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed778e30-6aa4-4924-87a0-cab41f6e5aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d62c8a74-77db-40c2-b381-b4cb6128150e tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-3b4cf0f4-fb58-4a66-9b23-42d38b8d2eb0-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Volume volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 (b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6): created successfully Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed778e30-6aa4-4924-87a0-cab41f6e5aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:24:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Flow 'volume_create_manager' (8bab21b5-d941-4933-8841-9c380284d42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:24:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4dc459a1-6bdd-460e-ad20-d2181eae136e tempest-VolumesListAdminTestJSON-1311189681 None] Created volume successfully. Jul 14 20:24:50 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 Jul 14 20:24:50 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Creating offline snapshot 3a0978e1-bcc6-4193-88a6-0dcd45feaa5c of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:51 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624" returned: 0 in 0.471s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[12001a1b-d483-4f07-a1f3-936b2881c39f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:51 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624 Jul 14 20:24:51 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:51 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:51 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:51 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b5184b0e-2a1a-4115-9204-f866111d1624" returned: 0 in 0.248s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-quobyte-b5184b0e-2a1a-4115-9204-f866111d1624" released by "delete_volume" :: held 0.820s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Created reservations ['251a1ecc-04c6-4b94-be9d-bfb232baac02', 'c288ac10-7770-406b-8c76-9fb934a7e6ff', 'bd3eade4-5d11-4420-93ae-9be823f732bc', '2ef8d9ee-ae45-4f28-a5cd-d41bdb7c880c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:51 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.414s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:51 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c 1G Jul 14 20:24:51 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:51 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:51 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Acquiring lock "cinder-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "cinder-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Acquiring lock "cinder-quobyte-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "cinder-quobyte-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-cf2e2056-4402-48b2-9999-c87d56ab1502-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5d2ab-ed65-48e5-88e6-c17aa3958c05]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-cf2e2056-4402-48b2-9999-c87d56ab1502-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:52 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.437s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Deleted volume successfully. Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-quobyte-cf2e2056-4402-48b2-9999-c87d56ab1502" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-70eca73f-1852-4cd5-af09-2d738a04f7c2 tempest-VolumesSnapshotTestJSON-314302992 None] Lock "cinder-b5184b0e-2a1a-4115-9204-f866111d1624-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-cf2e2056-4402-48b2-9999-c87d56ab1502" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[35462d32-f51a-4aaa-9ef9-d26584c7d958]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:52 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 Jul 14 20:24:52 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:52 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 Jul 14 20:24:52 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:52 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c 1G" returned: 0 in 0.787s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:52 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c Jul 14 20:24:52 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:52 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" returned: 0 in 0.697s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:52 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6 Jul 14 20:24:52 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:52 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502" returned: 0 in 0.580s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:52 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502 Jul 14 20:24:52 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:53 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" returned: 0 in 0.606s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c is being set with open permissions: ugo+rw Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:53 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c Jul 14 20:24:53 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:53 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "cinder-quobyte-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6" released by "delete_volume" :: held 1.172s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:53 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-cf2e2056-4402-48b2-9999-c87d56ab1502" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-cf2e2056-4402-48b2-9999-c87d56ab1502" released by "delete_volume" :: held 0.999s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Created reservations ['251fc5c5-d632-4299-b412-810ae7335206', '9d1610e6-e6e6-4c05-9b73-3bcd172f14f9', '9c43a1a3-1dbd-401d-97a2-3ae65f597bed', 'fa94838c-0221-436d-8f84-f34060bb7d68'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Created reservations ['5f7519cc-81df-4606-9d2a-f5661799f7a9', '1fb53899-494f-4bc6-936b-87b66ad25231', '2e329f0b-3dc3-4a7d-8596-a4837a77f221', '2b9877de-d1f9-435d-b541-55c7fbd288f2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:53 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:53 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:53 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:53 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-61f23206-c474-4299-ad24-590a8f750e3f tempest-SnapshotsActionsTest-1912045070 None] Create snapshot completed successfully Jul 14 20:24:53 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.292s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Deleted volume successfully. Jul 14 20:24:53 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.484s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1b8d05be-4088-4769-b3fc-37fcd620dc22 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-cf2e2056-4402-48b2-9999-c87d56ab1502-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Deleted volume successfully. Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a3d9753-27f3-461b-89b6-1477a3fa6a41 tempest-VolumesListAdminTestJSON-1311189681 None] Lock "cinder-b2635e34-9ee1-4047-9d4a-49c5d9c8d6c6-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-9609fc95-901e-473c-b16e-124b16671e4e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-9609fc95-901e-473c-b16e-124b16671e4e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-quobyte-9609fc95-901e-473c-b16e-124b16671e4e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-9609fc95-901e-473c-b16e-124b16671e4e" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9e8d7-b5d2-4ecc-b77b-b3b7d8bbbdd7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Deleting offline snapshot 3a0978e1-bcc6-4193-88a6-0dcd45feaa5c of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] snapshot_file for this snap is: volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb39a95b-dc5b-41ad-98b2-23d6d9d01f29]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:54 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e Jul 14 20:24:54 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:54 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c Jul 14 20:24:54 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:55 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e" returned: 0 in 0.531s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:55 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e Jul 14 20:24:55 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:55 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" returned: 0 in 0.590s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[750dcd03-a5f9-4a3c-af2b-168d1a840a06]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:55 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9609fc95-901e-473c-b16e-124b16671e4e" returned: 0 in 0.329s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-9609fc95-901e-473c-b16e-124b16671e4e" released by "delete_volume" :: held 0.931s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:55 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:55 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Created reservations ['80744496-bab2-48e8-8c75-8e4138baf676', 'bc8f9ec3-60c0-4541-8064-a3560442d40d', '901b9859-5c27-4431-b7fe-501f4149d5a2', 'e7039b36-c878-4b6e-9229-d4d0ad156e68'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:55 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:55 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:55 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.580s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:55 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c Jul 14 20:24:55 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-5fff392b-3cd2-49df-9a26-a9a4348187e7-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-5fff392b-3cd2-49df-9a26-a9a4348187e7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:56 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "cinder-quobyte-5fff392b-3cd2-49df-9a26-a9a4348187e7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.440s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Deleted volume successfully. Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-5fff392b-3cd2-49df-9a26-a9a4348187e7" acquired by "delete_volume" :: waited 0.043s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2144ef74-bead-4c5a-bf53-b87351d896d4 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-9609fc95-901e-473c-b16e-124b16671e4e-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa5119-713c-4699-ab98-420493de8c78]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:56 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 Jul 14 20:24:56 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:56 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" returned: 0 in 0.576s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:56 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c Jul 14 20:24:56 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:56 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:56 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7 Jul 14 20:24:56 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:56 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" returned: 0 in 0.411s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c" released by "_delete_snapshot" :: held 2.298s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_snapshot" :: held 2.335s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Created reservations ['ad609fa7-144c-40d4-96b5-10fe145a200f', 'c6875778-7416-4ead-8bb2-9811642c693b', '29ad2590-0f40-4439-b66e-d045ef37b876', '82570602-84a9-4153-a2bf-0b98762ca6e8'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:57 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5fff392b-3cd2-49df-9a26-a9a4348187e7" returned: 0 in 0.520s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-quobyte-5fff392b-3cd2-49df-9a26-a9a4348187e7" released by "delete_volume" :: held 1.096s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Delete snapshot completed successfully. Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8dd1bda0-9b16-4e45-aeee-4d4d6c533f5b tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-3a0978e1-bcc6-4193-88a6-0dcd45feaa5c-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Created reservations ['ef0a6dd8-ae06-4380-8f4b-dae5ce4145b9', '13e17d0b-6916-4227-926d-6a7c665abe63', 'ff409082-3c19-4d83-8a52-f91d01f481b6', '23c8e3eb-a422-4f8c-97e8-d18cea34de9f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:57 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:24:57 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:57 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:24:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Deleted volume successfully. Jul 14 20:24:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-330afeff-a300-45ee-aa0c-298a7490ccf9 tempest-VolumesListAdminTestJSON-147452247 None] Lock "cinder-5fff392b-3cd2-49df-9a26-a9a4348187e7-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Creating offline snapshot 490da384-ac47-4153-a926-ce4d0a278a4b of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb4be0-2794-4d8f-99ad-1caa17d01c40]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:58 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:24:58 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:58 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:24:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:58 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b 1G Jul 14 20:24:58 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:59 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b 1G" returned: 0 in 0.567s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:59 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b Jul 14 20:24:59 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:24:59 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 14 20:24:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:24:59 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b is being set with open permissions: ugo+rw Jul 14 20:24:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:24:59 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b Jul 14 20:24:59 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:00 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b" returned: 0 in 0.291s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4a98aa2e-6b22-4f7a-8c8f-3efe724bb775 tempest-SnapshotsActionsTest-1912045070 None] Create snapshot completed successfully Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-490da384-ac47-4153-a926-ce4d0a278a4b-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-490da384-ac47-4153-a926-ce4d0a278a4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Acquiring lock "cinder-quobyte-490da384-ac47-4153-a926-ce4d0a278a4b" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-490da384-ac47-4153-a926-ce4d0a278a4b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Deleting offline snapshot 490da384-ac47-4153-a926-ce4d0a278a4b of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] snapshot_file for this snap is: volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[03337ef1-f2c1-442a-a8fe-33f2b44e1ae7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:00 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b Jul 14 20:25:00 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:01 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b" returned: 0 in 0.480s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a706801-d62c-48b8-b774-76178c87e349]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:01 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:25:01 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:01 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.483s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:01 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b Jul 14 20:25:01 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:02 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:02 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b Jul 14 20:25:02 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:02 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.490da384-ac47-4153-a926-ce4d0a278a4b" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-490da384-ac47-4153-a926-ce4d0a278a4b" released by "_delete_snapshot" :: held 1.889s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_snapshot" :: held 1.928s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Created reservations ['a0f6fea2-5612-4dce-9581-888886e3ae78', 'e5c39678-9487-418e-9cbc-fe2ac57db6cc', 'a1cbd0d0-0c0f-4e8f-bb90-3f52fbc128c7', '828174b0-d434-477c-9e7e-e9f0f878b843'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Delete snapshot completed successfully. Jul 14 20:25:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff940fd0-c4c8-464f-b349-80181b5d3312 tempest-SnapshotsActionsTest-186865486 None] Lock "cinder-490da384-ac47-4153-a926-ce4d0a278a4b-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:03 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:03 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "cinder-7dca8e43-8932-4ad8-8558-e06739fa35a4-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-7dca8e43-8932-4ad8-8558-e06739fa35a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "cinder-quobyte-7dca8e43-8932-4ad8-8558-e06739fa35a4" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-7dca8e43-8932-4ad8-8558-e06739fa35a4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Deleting offline snapshot 7dca8e43-8932-4ad8-8558-e06739fa35a4 of volume 23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] snapshot_file for this snap is: volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f8831-6422-4ffc-872b-14680604caa8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:03 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:25:03 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:03 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.421s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:25:03 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[63227be5-06c8-4ba0-8ce3-46eef21e555b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:04 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 Jul 14 20:25:04 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (6c7ebb6a-146f-4dde-888c-b426de8c1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e224cf4-ce28-4746-9e91-572325b01e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e224cf4-ce28-4746-9e91-572325b01e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1427260711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293389fb-e65f-45ee-ba2d-82ec89536118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4877406d63704c139bf3ce88804408c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:04Z,use_quota=True,user_id='0082a75340d546d6957e9f52a3c8c6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164241bd-b91e-4e83-8727-27b04ca56f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164241bd-b91e-4e83-8727-27b04ca56f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f04bd5-1e31-4dc0-bee8-0c1c392d43e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f04bd5-1e31-4dc0-bee8-0c1c392d43e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293389fb-e65f-45ee-ba2d-82ec89536118', 'volume_name': 'volume-293389fb-e65f-45ee-ba2d-82ec89536118', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139eb58c-2cfe-4647-9b07-5811c879cad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139eb58c-2cfe-4647-9b07-5811c879cad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e906ba9c-c717-4b02-bfe1-778dc3b4a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Volume 293389fb-e65f-45ee-ba2d-82ec89536118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293389fb-e65f-45ee-ba2d-82ec89536118', 'volume_size': 1} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1427260711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293389fb-e65f-45ee-ba2d-82ec89536118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4877406d63704c139bf3ce88804408c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:04Z,use_quota=True,user_id='0082a75340d546d6957e9f52a3c8c6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Creating volume 293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:04 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:04 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 1073741824 Jul 14 20:25:04 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:04 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" returned: 0 in 0.551s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:04 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:25:04 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:04 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.425s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:04 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4 Jul 14 20:25:04 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:05 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 1073741824" returned: 0 in 0.559s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:05 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:05 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:05 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5.7dca8e43-8932-4ad8-8558-e06739fa35a4" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-7dca8e43-8932-4ad8-8558-e06739fa35a4" released by "_delete_snapshot" :: held 1.972s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_snapshot" :: held 2.010s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:05 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.363s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e906ba9c-c717-4b02-bfe1-778dc3b4a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293389fb-e65f-45ee-ba2d-82ec89536118', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade80dc7-fbfb-4af1-b44f-cf4e808dd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Flow 'volume_create_manager' (528e87a1-03bc-4a76-ac10-586f41724c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b045eaa5-33bf-4df5-8053-5f9f8719173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Volume volume-293389fb-e65f-45ee-ba2d-82ec89536118 (293389fb-e65f-45ee-ba2d-82ec89536118): created successfully Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade80dc7-fbfb-4af1-b44f-cf4e808dd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (6c7ebb6a-146f-4dde-888c-b426de8c1081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b045eaa5-33bf-4df5-8053-5f9f8719173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411a5386-1b8e-4a8c-bed6-0dfc47382122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3376481fb4fc5a62b7493ce790063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:05Z,use_quota=True,user_id='76bd7a72219e497a9349d24474b4b146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b34f2d30-a3ef-406f-8384-3e26cfe0c121),volume_type_id=b34f2d30-a3ef-406f-8384-3e26cfe0c121)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66359bd6-5709-4c80-92a9-cdb09c88d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66359bd6-5709-4c80-92a9-cdb09c88d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c99bdb-97eb-4177-baf7-9b1258f45127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:25:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-37954940-51f0-4032-b5be-d9a1a48c57b6 tempest-VolumesDeleteCascade-2136533043 None] Created volume successfully. Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Created reservations ['519b68a6-afe8-4fc1-85ac-a60b8b5918b3', '79040a0d-8fa3-4da9-b8a8-5f043c5ec47e', 'a8d7180c-45e1-4d2e-9814-ff884234a5d9', 'e1fe4470-6a07-4ea0-ace2-9d24c3e35b5f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Delete snapshot completed successfully. Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c01f1e6d-efc7-444d-93ab-e4bf01ad9337 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-7dca8e43-8932-4ad8-8558-e06739fa35a4-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c99bdb-97eb-4177-baf7-9b1258f45127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '411a5386-1b8e-4a8c-bed6-0dfc47382122', 'volume_name': 'volume-411a5386-1b8e-4a8c-bed6-0dfc47382122', 'volume_size': 1, 'image_id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a67303eaa6c5d72e4b312e31677e5e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5f3376481fb4fc5a62b7493ce790063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e932d525b6a1465936b5f6c2f5e3b7bc6dda4288ddbad5b2a9f39a00cbba85b816c7efa02ff6e013f9a8048610f7ffa0b9ceeae98ab63a7a8860177cacbaab3e', 'id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'created_at': datetime.datetime(2026, 7, 14, 18, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c457f206-b3c8-4a06-9037-98618597f7f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24841e61-8ac9-45e0-801e-8df9bf9f0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24841e61-8ac9-45e0-801e-8df9bf9f0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa8a18a-746a-4dc1-9796-77619b08df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Volume 411a5386-1b8e-4a8c-bed6-0dfc47382122: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-411a5386-1b8e-4a8c-bed6-0dfc47382122', 'volume_size': 1, 'image_id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a67303eaa6c5d72e4b312e31677e5e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5f3376481fb4fc5a62b7493ce790063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e932d525b6a1465936b5f6c2f5e3b7bc6dda4288ddbad5b2a9f39a00cbba85b816c7efa02ff6e013f9a8048610f7ffa0b9ceeae98ab63a7a8860177cacbaab3e', 'id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'created_at': datetime.datetime(2026, 7, 14, 18, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c457f206-b3c8-4a06-9037-98618597f7f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 20:25:05 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Trying to clone 411a5386-1b8e-4a8c-bed6-0dfc47382122 from image c457f206-b3c8-4a06-9037-98618597f7f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:25:06 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Image download 0.00 MB at 0.00 MB/s Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac2b54-694f-40e6-90ac-9751aaaf6485]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:06 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:06 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:06 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:06 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:06 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "cinder-23260cf4-9d4b-4ea6-a49b-8f476208e5c5-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-23260cf4-9d4b-4ea6-a49b-8f476208e5c5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Creating offline snapshot 4a3bcf3d-3258-4165-ba44-6e2f42169cc1 of volume 293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9e6de-8973-412b-9b61-008a9f70205c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" acquired by "delete_volume" :: waited 0.036s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af763f-0310-4e9a-af92-3ce57b640f72]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:06 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:06 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:06 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:06 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Temporary image c457f206-b3c8-4a06-9037-98618597f7f0 is fetched for user 76bd7a72219e497a9349d24474b4b146. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:25:07 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 Jul 14 20:25:07 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e5e9d1-c4b1-41e8-91d2-917c2225f465]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:07 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:07 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:07 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.524s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:07 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:07 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 1G Jul 14 20:25:07 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:07 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5 Jul 14 20:25:07 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:07 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:07 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:07 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:07 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" returned: 0 in 0.444s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-quobyte-23260cf4-9d4b-4ea6-a49b-8f476208e5c5" released by "delete_volume" :: held 1.002s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Created reservations ['4a31229a-0265-4659-8d8a-3a68d7c00796', 'a7782fca-e303-4b28-9709-7fa3e2687188', 'e147ad8b-57ed-47a5-a51c-a99337f227f0', '3f3e52b7-7279-4200-9f94-d7e290eeea41'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:07 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 1G" returned: 0 in 0.648s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:07 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 1 in 0.478s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:08 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:08 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:08 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:08 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:08 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:08 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:08 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 is being set with open permissions: ugo+rw Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Deleted volume successfully. Jul 14 20:25:08 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:08 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e6041faf-cc08-4a6b-ba5f-4bd7c63f6547 tempest-SnapshotsActionsTest-1912045070 None] Lock "cinder-23260cf4-9d4b-4ea6-a49b-8f476208e5c5-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:08 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:08 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info Jul 14 20:25:08 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:08 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:08 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info is being set with open permissions: ugo+rw Jul 14 20:25:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:08 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info Jul 14 20:25:08 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:09 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.info" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411a5386-1b8e-4a8c-bed6-0dfc47382122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f3376481fb4fc5a62b7493ce790063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:05Z,use_quota=True,user_id='76bd7a72219e497a9349d24474b4b146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b34f2d30-a3ef-406f-8384-3e26cfe0c121),volume_type_id=b34f2d30-a3ef-406f-8384-3e26cfe0c121)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Creating volume 411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:09 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:09 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1073741824 Jul 14 20:25:09 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fc45551b-002b-42a2-88b1-473cbd1eba4e tempest-VolumesDeleteCascade-2136533043 None] Create snapshot completed successfully Jul 14 20:25:09 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1073741824" returned: 0 in 0.665s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:10 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:10 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:10 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 0 in 0.338s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Creating offline snapshot cacb3831-08b0-42a5-a309-3ae153727068 of volume 293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Attempting download of c457f206-b3c8-4a06-9037-98618597f7f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}])) to volume 411a5386-1b8e-4a8c-bed6-0dfc47382122. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc1d16-5192-437e-9e21-1316838ef086]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98cb651-6cee-4b12-acc7-c445043c4fe5]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:10 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:10 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:10 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m Jul 14 20:25:10 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:10 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:10 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m" returned: 0 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.507s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293389fb-e65f-45ee-ba2d-82ec89536118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:11 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 1G Jul 14 20:25:11 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:11 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m Jul 14 20:25:11 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:11 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m" returned: 1 in 0.417s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c457f206-b3c8-4a06-9037-98618597f7f0_4rik_e4m' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b95273-9003-4fc8-8473-5beaf52bf4ac]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:11 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:11 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:11 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 1G" returned: 0 in 0.651s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:11 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:11 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:11 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:12 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:12 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 is being set with open permissions: ugo+rw Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:12 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD Jul 14 20:25:12 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:12 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:12 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:12 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] c457f206-b3c8-4a06-9037-98618597f7f0 was raw, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:12 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:12 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:12 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.337s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-95a10ca2-98c1-492d-81b3-cf2f3e403623 tempest-VolumesDeleteCascade-2136533043 None] Create snapshot completed successfully Jul 14 20:25:12 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 0 in 0.410s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c457f206-b3c8-4a06-9037-98618597f7f0_fvl8n8gadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:25:12 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 20:25:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:12 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1G Jul 14 20:25:12 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:13 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 1G" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb78a0a-197b-43fe-8119-e2ed03feeb67]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-293389fb-e65f-45ee-ba2d-82ec89536118-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:13 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:13 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-293389fb-e65f-45ee-ba2d-82ec89536118-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Performing cascade delete. {{(pid=87600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-4a3bcf3d-3258-4165-ba44-6e2f42169cc1-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-4a3bcf3d-3258-4165-ba44-6e2f42169cc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-4a3bcf3d-3258-4165-ba44-6e2f42169cc1" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-4a3bcf3d-3258-4165-ba44-6e2f42169cc1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Deleting offline snapshot 4a3bcf3d-3258-4165-ba44-6e2f42169cc1 of volume 293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] snapshot_file for this snap is: volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd8710-230e-4f29-aec0-0c367eaac440]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:13 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 0 in 0.495s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:13 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:13 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:13 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:13 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:13 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.419s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293389fb-e65f-45ee-ba2d-82ec89536118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c76b89-ebfd-451b-8e10-b85d5d19bf2e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:14 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 1 in 0.441s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Downloaded image c457f206-b3c8-4a06-9037-98618597f7f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}])) to volume 411a5386-1b8e-4a8c-bed6-0dfc47382122 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Temporary image c457f206-b3c8-4a06-9037-98618597f7f0 for user 76bd7a72219e497a9349d24474b4b146 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Marking volume 411a5386-1b8e-4a8c-bed6-0dfc47382122 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Copying metadata from image c457f206-b3c8-4a06-9037-98618597f7f0 to 411a5386-1b8e-4a8c-bed6-0dfc47382122. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Creating volume glance metadata for volume 411a5386-1b8e-4a8c-bed6-0dfc47382122 backed by image c457f206-b3c8-4a06-9037-98618597f7f0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9a67303eaa6c5d72e4b312e31677e5e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:25:14 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:14 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa8a18a-746a-4dc1-9796-77619b08df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411a5386-1b8e-4a8c-bed6-0dfc47382122', 'volume_size': 1, 'image_id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c457f206-b3c8-4a06-9037-98618597f7f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a67303eaa6c5d72e4b312e31677e5e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5f3376481fb4fc5a62b7493ce790063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e932d525b6a1465936b5f6c2f5e3b7bc6dda4288ddbad5b2a9f39a00cbba85b816c7efa02ff6e013f9a8048610f7ffa0b9ceeae98ab63a7a8860177cacbaab3e', 'id': 'c457f206-b3c8-4a06-9037-98618597f7f0', 'created_at': datetime.datetime(2026, 7, 14, 18, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 25, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c457f206-b3c8-4a06-9037-98618597f7f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8ff8cd-be67-4a9d-9593-1be27c78f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Volume volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 (411a5386-1b8e-4a8c-bed6-0dfc47382122): created successfully Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8ff8cd-be67-4a9d-9593-1be27c78f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Flow 'volume_create_manager' (528e87a1-03bc-4a76-ac10-586f41724c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:14 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a6c8fb62-014f-4111-bd3c-a370b81bda21 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Created volume successfully. Jul 14 20:25:14 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.459s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aae3b7-b0ba-4fda-ad9c-661d61c48168]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:14 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:14 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:14 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.411s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293389fb-e65f-45ee-ba2d-82ec89536118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e3af3-7c81-4421-b063-e70d7d3fb9a0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:15 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:15 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Acquiring lock "cinder-411a5386-1b8e-4a8c-bed6-0dfc47382122-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "cinder-411a5386-1b8e-4a8c-bed6-0dfc47382122-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Acquiring lock "cinder-quobyte-411a5386-1b8e-4a8c-bed6-0dfc47382122" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "cinder-quobyte-411a5386-1b8e-4a8c-bed6-0dfc47382122" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b6a4f-b4f6-4b18-a26e-55ecc867ef07]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:15 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.480s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293389fb-e65f-45ee-ba2d-82ec89536118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c449a5-14ef-43b7-aa9f-4bf9a33e088b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:15 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:15 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:15 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:15 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:15 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:15 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:15 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:16 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.545s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:16 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:16 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:16 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 1 in 0.427s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:16 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122 Jul 14 20:25:16 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:16 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.435s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:16 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1 Jul 14 20:25:16 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:16 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-411a5386-1b8e-4a8c-bed6-0dfc47382122" returned: 0 in 0.340s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "cinder-quobyte-411a5386-1b8e-4a8c-bed6-0dfc47382122" released by "delete_volume" :: held 1.329s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:16 devstack cinder-volume[87600]: WARNING cinder.quota [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:25:16 devstack cinder-volume[87600]: WARNING cinder.quota [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Created reservations ['4e8fc8f8-f3fd-414e-93ac-fc1d3594209e', '39e63d5d-01d8-4293-815d-43422f6bd19b', '1fc15d8c-fe06-4488-9cc5-93c42bbd8c5d', '9a7d2216-f646-40ee-8348-4049d014f60f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:16 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.4a3bcf3d-3258-4165-ba44-6e2f42169cc1" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 -F qcow2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:16 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 -F qcow2 Jul 14 20:25:16 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:16 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:16 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:17 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.418s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Deleted volume successfully. Jul 14 20:25:17 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293389fb-e65f-45ee-ba2d-82ec89536118 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 -F qcow2" returned: 0 in 0.495s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-4a3bcf3d-3258-4165-ba44-6e2f42169cc1" released by "_delete_snapshot" :: held 3.826s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e941e333-adcb-4bd7-abe9-136839752946 tempest-VolumeAndVolumeTypeFromImageTest-1315284104 None] Lock "cinder-411a5386-1b8e-4a8c-bed6-0dfc47382122-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" released by "delete_snapshot" :: held 3.858s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['1ee9525f-7528-49ee-8a77-d07c7959f31b', '3924e410-cb75-44c8-8e69-ba81367167e9', 'b61c50f3-cb23-4ac1-baf6-d7bffbf2dced', '746b1d47-2378-4bf9-afe8-bec98859f9db'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Delete snapshot completed successfully. Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-4a3bcf3d-3258-4165-ba44-6e2f42169cc1-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-cacb3831-08b0-42a5-a309-3ae153727068-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-cacb3831-08b0-42a5-a309-3ae153727068-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-cacb3831-08b0-42a5-a309-3ae153727068" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-cacb3831-08b0-42a5-a309-3ae153727068" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Deleting offline snapshot cacb3831-08b0-42a5-a309-3ae153727068 of volume 293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] snapshot_file for this snap is: volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[36708bd7-a22c-401e-a6eb-b379cbb71385]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:17 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:17 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:18 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Flow 'volume_create_manager' (6c6502c5-7d00-4bdf-acc3-c241c2710c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c3276a-5fef-4321-902c-0e8809f0ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.718s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293389fb-e65f-45ee-ba2d-82ec89536118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c3276a-5fef-4321-902c-0e8809f0ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1061933423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1d3746-7029-40b5-8688-a86fc89e353d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a3643589f4c238b7889fb2d980f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:18Z,use_quota=True,user_id='ced2733ebf9447f4be86ecc7ecfae8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24448ff7-30de-43b7-bab1-e855187dbf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24448ff7-30de-43b7-bab1-e855187dbf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebdd371-c237-4e5f-82ba-000e04a53484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebdd371-c237-4e5f-82ba-000e04a53484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1d3746-7029-40b5-8688-a86fc89e353d', 'volume_name': 'volume-3d1d3746-7029-40b5-8688-a86fc89e353d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea3040a-92a8-4aec-bcc9-79a3d3f76e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea3040a-92a8-4aec-bcc9-79a3d3f76e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea98388-972f-4697-bbcf-a0501e06785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:18 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume 3d1d3746-7029-40b5-8688-a86fc89e353d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1d3746-7029-40b5-8688-a86fc89e353d', 'volume_size': 1} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1061933423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1d3746-7029-40b5-8688-a86fc89e353d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a3643589f4c238b7889fb2d980f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:18Z,use_quota=True,user_id='ced2733ebf9447f4be86ecc7ecfae8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Creating volume 3d1d3746-7029-40b5-8688-a86fc89e353d {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:18 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff5dff-2b57-4703-b27c-bf5a6a75befd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:18 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d 1073741824 Jul 14 20:25:18 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:18 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:18 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:19 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.564s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:19 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:19 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:19 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d 1073741824" returned: 0 in 0.701s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:19 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d Jul 14 20:25:19 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:19 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d" returned: 0 in 0.318s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:19 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.497s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea98388-972f-4697-bbcf-a0501e06785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1d3746-7029-40b5-8688-a86fc89e353d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ab0aa9-e873-47c0-88ab-63c4f6e02cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:19 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068 Jul 14 20:25:19 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume volume-3d1d3746-7029-40b5-8688-a86fc89e353d (3d1d3746-7029-40b5-8688-a86fc89e353d): created successfully Jul 14 20:25:19 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ab0aa9-e873-47c0-88ab-63c4f6e02cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Flow 'volume_create_manager' (6c6502c5-7d00-4bdf-acc3-c241c2710c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2d347f52-b365-4ba8-915a-706d8ab48dff tempest-VolumeQuotasAdminTestJSON-1270302621 None] Created volume successfully. Jul 14 20:25:19 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118.cacb3831-08b0-42a5-a309-3ae153727068" returned: 0 in 0.292s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-cacb3831-08b0-42a5-a309-3ae153727068" released by "_delete_snapshot" :: held 2.320s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" released by "delete_snapshot" :: held 2.355s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['a0d61e54-1118-40fc-b2da-68a64ae8b46f', 'afd7711e-5bc3-49e8-8595-f8e2223c1aa2', '7c69d7b4-f870-4f3c-8c6e-55fad382da02', '994bfaf4-f8a7-49af-a346-ce1c0d4c327b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Delete snapshot completed successfully. Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-cacb3831-08b0-42a5-a309-3ae153727068-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Snapshots deleted, issuing volume delete {{(pid=87600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22573f-3aac-4dd1-8922-9a59404c372a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:20 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:20 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "cinder-3d1d3746-7029-40b5-8688-a86fc89e353d-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "cinder-3d1d3746-7029-40b5-8688-a86fc89e353d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "cinder-quobyte-3d1d3746-7029-40b5-8688-a86fc89e353d" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "cinder-quobyte-3d1d3746-7029-40b5-8688-a86fc89e353d" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c9b65-4377-4423-ac94-19cabd04fbf5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:20 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.600s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:20 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118 Jul 14 20:25:20 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:20 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d Jul 14 20:25:20 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:21 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-293389fb-e65f-45ee-ba2d-82ec89536118" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-293389fb-e65f-45ee-ba2d-82ec89536118" released by "delete_volume" :: held 1.040s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:21 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d" returned: 0 in 0.539s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['45dc7601-721a-467b-8dda-62274af51b67', 'b552206d-fb30-48ec-9a51-85c1284a0674', 'b562ea0a-c78f-43a3-9dd0-5f3ff1ccd7fd', '2a282832-8f3c-4e0b-8574-1d9a6819bdfd'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:21 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d Jul 14 20:25:21 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:21 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:21 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:21 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:21 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Deleted volume successfully. Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3d1d3746-7029-40b5-8688-a86fc89e353d" returned: 0 in 0.411s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "cinder-quobyte-3d1d3746-7029-40b5-8688-a86fc89e353d" released by "delete_volume" :: held 1.019s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d2b7e096-c15c-406e-8096-8e68ddf41ee3 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-293389fb-e65f-45ee-ba2d-82ec89536118-delete_volume" released by "delete_volume" :: held 8.431s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Created reservations ['ef2792b6-f62d-480c-be1e-e0929937285c', '511192b8-16c9-46e0-8d24-6300c8c6db88', '3fa23932-0f24-4c50-bf9f-17cb86bef258', '927c9853-68f2-41f6-a9c9-c6a10b6aea09'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:21 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:21 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:22 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:22 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Deleted volume successfully. Jul 14 20:25:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ff84bef7-dfc3-4901-bc23-fd233f74b718 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "cinder-3d1d3746-7029-40b5-8688-a86fc89e353d-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (c7fcfdc5-4868-4b36-b607-bf7832f8fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d092a1c-2581-4514-ac41-0a643688c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d092a1c-2581-4514-ac41-0a643688c058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-416802673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202c87e3-5118-4c95-a223-cada8c09c7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4877406d63704c139bf3ce88804408c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:23Z,use_quota=True,user_id='0082a75340d546d6957e9f52a3c8c6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796eb005-252c-4389-9b47-a8d650003295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796eb005-252c-4389-9b47-a8d650003295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f788c-5bb6-4ce3-8b91-ae7c63f1fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f788c-5bb6-4ce3-8b91-ae7c63f1fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202c87e3-5118-4c95-a223-cada8c09c7ce', 'volume_name': 'volume-202c87e3-5118-4c95-a223-cada8c09c7ce', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eace2f-09ab-4c71-b3b8-81bb8aebdc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eace2f-09ab-4c71-b3b8-81bb8aebdc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4884ee03-1809-42c9-a906-77c292a48588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Volume 202c87e3-5118-4c95-a223-cada8c09c7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202c87e3-5118-4c95-a223-cada8c09c7ce', 'volume_size': 1} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-416802673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202c87e3-5118-4c95-a223-cada8c09c7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4877406d63704c139bf3ce88804408c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:23Z,use_quota=True,user_id='0082a75340d546d6957e9f52a3c8c6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Creating volume 202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:23 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:23 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce 1073741824 Jul 14 20:25:23 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Flow 'volume_create_manager' (3193b0db-a1d4-488f-af08-1c6b4af0040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e802432-9c1f-4da5-be0c-137d12081e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e802432-9c1f-4da5-be0c-137d12081e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1267602447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f060f5-5cf8-47f6-9797-5eedcad757b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a3643589f4c238b7889fb2d980f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:24Z,use_quota=True,user_id='ced2733ebf9447f4be86ecc7ecfae8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603506cb-bb3b-403a-983d-87721773c28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603506cb-bb3b-403a-983d-87721773c28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a08ca1c-aa15-4471-9830-795469f26fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a08ca1c-aa15-4471-9830-795469f26fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f060f5-5cf8-47f6-9797-5eedcad757b7', 'volume_name': 'volume-60f060f5-5cf8-47f6-9797-5eedcad757b7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387522f6-a22f-4926-bf6d-7eff142f6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387522f6-a22f-4926-bf6d-7eff142f6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f299054b-90cb-4330-bc24-3cf9849bdeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume 60f060f5-5cf8-47f6-9797-5eedcad757b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f060f5-5cf8-47f6-9797-5eedcad757b7', 'volume_size': 1} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce 1073741824" returned: 0 in 0.539s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:23 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:23 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:24 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1267602447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f060f5-5cf8-47f6-9797-5eedcad757b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0a3643589f4c238b7889fb2d980f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:24Z,use_quota=True,user_id='ced2733ebf9447f4be86ecc7ecfae8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Creating volume 60f060f5-5cf8-47f6-9797-5eedcad757b7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=185,cinder:INSERT=56,cinder:UPDATE=221,cinder:DELETE=20 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:25:24 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 1073741824 Jul 14 20:25:24 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4884ee03-1809-42c9-a906-77c292a48588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202c87e3-5118-4c95-a223-cada8c09c7ce', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e8c73c-c60f-4dbf-b716-ce4e9e7fe7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=174,cinder:UPDATE=219,cinder:DELETE=14,cinder:INSERT=67 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:25:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Volume volume-202c87e3-5118-4c95-a223-cada8c09c7ce (202c87e3-5118-4c95-a223-cada8c09c7ce): created successfully Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e8c73c-c60f-4dbf-b716-ce4e9e7fe7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (c7fcfdc5-4868-4b36-b607-bf7832f8fc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (eff0f7e4-0866-48fd-9357-97a57e3a5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7e5781-81c3-4019-8fb7-639058efff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c2d02b1b-e442-4be7-b6f0-08373425a612 tempest-VolumesDeleteCascade-2136533043 None] Created volume successfully. Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7e5781-81c3-4019-8fb7-639058efff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1685675055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ff001-e26b-4203-983d-78ccaf3a1ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:24Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c4234-2995-4037-9e6a-497cb4b36150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c4234-2995-4037-9e6a-497cb4b36150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ea9279-3ef8-48de-81a3-dc2d2c6fa38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ea9279-3ef8-48de-81a3-dc2d2c6fa38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607ff001-e26b-4203-983d-78ccaf3a1ebf', 'volume_name': 'volume-607ff001-e26b-4203-983d-78ccaf3a1ebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890e355c-d858-4725-8fb6-24454e6be072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890e355c-d858-4725-8fb6-24454e6be072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353b2128-248b-4693-9f97-0fe3dc1584f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Volume 607ff001-e26b-4203-983d-78ccaf3a1ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607ff001-e26b-4203-983d-78ccaf3a1ebf', 'volume_size': 1} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (ac867c83-1f41-4cd1-a611-9cda186d1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d20904-ad19-4a25-b2bc-80b125a3d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d20904-ad19-4a25-b2bc-80b125a3d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194171404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46213d0-5861-4de7-b904-5a690aa170d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:25Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f84de6c-35a1-4ff1-afaf-9d18cbe4a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f84de6c-35a1-4ff1-afaf-9d18cbe4a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9d7b74-fb11-4765-b880-cfb09d7647d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9d7b74-fb11-4765-b880-cfb09d7647d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46213d0-5861-4de7-b904-5a690aa170d7', 'volume_name': 'volume-c46213d0-5861-4de7-b904-5a690aa170d7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a2086f-72d5-4ece-8c44-373b8ab73880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a2086f-72d5-4ece-8c44-373b8ab73880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f51685-9a15-4554-a81b-c89343525774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Volume c46213d0-5861-4de7-b904-5a690aa170d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46213d0-5861-4de7-b904-5a690aa170d7', 'volume_size': 1} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:24 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 1073741824" returned: 0 in 0.632s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:24 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 Jul 14 20:25:24 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (e45f253b-f242-41c0-b5e2-5cb34bb3a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b34d11-7038-4740-9590-5e4c34fc59cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7" returned: 0 in 0.287s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1685675055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ff001-e26b-4203-983d-78ccaf3a1ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:24Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Creating volume 607ff001-e26b-4203-983d-78ccaf3a1ebf {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:25 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b34d11-7038-4740-9590-5e4c34fc59cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144608671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44408478-e948-4f8f-b8c3-0e0fd10fc12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:25Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9148a854-8b6d-413c-8477-33314760afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf 1073741824 Jul 14 20:25:25 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9148a854-8b6d-413c-8477-33314760afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b81331-fd83-4243-9dd4-050b7476a7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b81331-fd83-4243-9dd4-050b7476a7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44408478-e948-4f8f-b8c3-0e0fd10fc12f', 'volume_name': 'volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ce27f-0680-40d9-8034-41d32c371abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ce27f-0680-40d9-8034-41d32c371abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99219fd-efec-4b68-af54-da008fe2c22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Volume 44408478-e948-4f8f-b8c3-0e0fd10fc12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f', 'volume_size': 1} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f299054b-90cb-4330-bc24-3cf9849bdeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f060f5-5cf8-47f6-9797-5eedcad757b7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287d6327-83f8-4b84-80ed-05b7c91666f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Volume volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 (60f060f5-5cf8-47f6-9797-5eedcad757b7): created successfully Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287d6327-83f8-4b84-80ed-05b7c91666f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Flow 'volume_create_manager' (3193b0db-a1d4-488f-af08-1c6b4af0040e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f393ae2f-b41d-4c4d-8cf1-95a45922a3d3 tempest-VolumeQuotasAdminTestJSON-1270302621 None] Created volume successfully. Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (7a2516b0-8660-443d-a2a0-c07851077147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e9aac-c775-4f76-a774-e530673f2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e9aac-c775-4f76-a774-e530673f2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38457784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1157a21-8e98-4cae-9ebd-cc22bb09229d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:26Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2186b2-97a6-40ba-8aa7-395876f1f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2186b2-97a6-40ba-8aa7-395876f1f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25949d7-e985-4653-b9a4-885e2ddba3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25949d7-e985-4653-b9a4-885e2ddba3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1157a21-8e98-4cae-9ebd-cc22bb09229d', 'volume_name': 'volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8380beb-2710-42cc-8a0a-0d30e6381111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8380beb-2710-42cc-8a0a-0d30e6381111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef7287-fe5f-441a-b632-fe385981e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Volume a1157a21-8e98-4cae-9ebd-cc22bb09229d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d', 'volume_size': 1} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:25 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf 1073741824" returned: 0 in 0.652s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:25 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf Jul 14 20:25:25 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (111b87a6-0df9-4703-8d80-be23f71adccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b080caf1-862e-4d29-a79f-4de6a67b9b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b080caf1-862e-4d29-a79f-4de6a67b9b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006165680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8f00e3-4625-4ff0-9921-630bcf1711a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:26Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465133b5-de88-45e9-b4d9-66ae4fe03e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465133b5-de88-45e9-b4d9-66ae4fe03e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1c67cb-72b9-41da-9a1b-9682bcaa3b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1c67cb-72b9-41da-9a1b-9682bcaa3b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8f00e3-4625-4ff0-9921-630bcf1711a0', 'volume_name': 'volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858769af-c1b1-4d5d-ad86-6df370d83a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858769af-c1b1-4d5d-ad86-6df370d83a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f64675-3fc3-4637-b3c2-6255741e2f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Volume fa8f00e3-4625-4ff0-9921-630bcf1711a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0', 'volume_size': 1} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:26 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194171404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46213d0-5861-4de7-b904-5a690aa170d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:25Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Creating volume c46213d0-5861-4de7-b904-5a690aa170d7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:26 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353b2128-248b-4693-9f97-0fe3dc1584f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607ff001-e26b-4203-983d-78ccaf3a1ebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 1073741824 Jul 14 20:25:26 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e4a093-4444-4ba9-824a-f844a1be5058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Volume volume-607ff001-e26b-4203-983d-78ccaf3a1ebf (607ff001-e26b-4203-983d-78ccaf3a1ebf): created successfully Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e4a093-4444-4ba9-824a-f844a1be5058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (eff0f7e4-0866-48fd-9357-97a57e3a5839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c7355b31-7ebf-4d47-aa2f-2a79b3b25a4f tempest-CreateVolumesFromImageTest-171050571 None] Created volume successfully. Jul 14 20:25:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b7b2b17e-d43e-4e97-9b73-d2a4b45c79bc tempest-VolumeQuotasAdminTestJSON-603093549 None] Transfer volume completed successfully. Jul 14 20:25:26 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 1073741824" returned: 0 in 0.509s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:26 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 Jul 14 20:25:26 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:27 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7" returned: 0 in 0.317s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144608671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44408478-e948-4f8f-b8c3-0e0fd10fc12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:25Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Creating volume 44408478-e948-4f8f-b8c3-0e0fd10fc12f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:27 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f51685-9a15-4554-a81b-c89343525774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46213d0-5861-4de7-b904-5a690aa170d7', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea3ad2a-155b-43f1-9734-e3f03d5c762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Volume volume-c46213d0-5861-4de7-b904-5a690aa170d7 (c46213d0-5861-4de7-b904-5a690aa170d7): created successfully Jul 14 20:25:27 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f 1073741824 Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea3ad2a-155b-43f1-9734-e3f03d5c762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:27 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (ac867c83-1f41-4cd1-a611-9cda186d1a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cdb2a60c-67e2-46d4-be25-e45e78d2a6e4 tempest-CreateVolumesFromImageTest-171050571 None] Created volume successfully. Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Acquiring lock "cinder-60f060f5-5cf8-47f6-9797-5eedcad757b7-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "cinder-60f060f5-5cf8-47f6-9797-5eedcad757b7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Acquiring lock "cinder-quobyte-60f060f5-5cf8-47f6-9797-5eedcad757b7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "cinder-quobyte-60f060f5-5cf8-47f6-9797-5eedcad757b7" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb2039a-f288-413c-824a-88236974c53f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:27 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 Jul 14 20:25:27 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:27 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f 1073741824" returned: 0 in 0.674s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:27 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f Jul 14 20:25:27 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:27 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7" returned: 0 in 0.473s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:27 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7 Jul 14 20:25:27 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:28 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.479s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99219fd-efec-4b68-af54-da008fe2c22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99cf7e4-0fa4-46ba-9c8a-28f131257692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Creating offline snapshot 793fa0a2-8728-47d3-bfe9-d356f65145f5 of volume 202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:25:28 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-60f060f5-5cf8-47f6-9797-5eedcad757b7" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:28 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Volume volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f (44408478-e948-4f8f-b8c3-0e0fd10fc12f): created successfully Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99cf7e4-0fa4-46ba-9c8a-28f131257692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (e45f253b-f242-41c0-b5e2-5cb34bb3a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "cinder-quobyte-60f060f5-5cf8-47f6-9797-5eedcad757b7" released by "delete_volume" :: held 0.886s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944b3a9-6b3b-41f0-94fb-a22021d137c7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e8ba4504-ef4a-4080-a97d-f6f0d97a992e tempest-CreateVolumesFromImageTest-171050571 None] Created volume successfully. Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Created reservations ['3548caf9-b7bb-4a40-b164-84be50319291', 'fa2caa63-a2d0-4470-ab2e-fecf26761e89', 'a0ad5087-e367-40e0-b48d-62fd3b593417', '8305d08a-1c88-429d-995e-a5087c07a2b1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:28 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:28 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:28 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:28 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:28 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.290s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Deleted volume successfully. Jul 14 20:25:28 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.471s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5802d61f-a5d1-421d-9c78-4961b925dc34 tempest-VolumeQuotasAdminTestJSON-2065674996 None] Lock "cinder-60f060f5-5cf8-47f6-9797-5eedcad757b7-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:28 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 1G Jul 14 20:25:28 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:29 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 1G" returned: 0 in 0.545s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202c87e3-5118-4c95-a223-cada8c09c7ce -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:29 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202c87e3-5118-4c95-a223-cada8c09c7ce -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:29 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:29 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202c87e3-5118-4c95-a223-cada8c09c7ce -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:29 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 is being set with open permissions: ugo+rw Jul 14 20:25:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:29 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:29 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:30 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.337s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:30 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info Jul 14 20:25:30 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:30 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info" returned: 0 in 0.389s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:30 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info is being set with open permissions: ugo+rw Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:30 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info Jul 14 20:25:30 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:30 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.info" returned: 0 in 0.363s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.081s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38457784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1157a21-8e98-4cae-9ebd-cc22bb09229d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:26Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Creating volume a1157a21-8e98-4cae-9ebd-cc22bb09229d {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:30 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:30 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d 1073741824 Jul 14 20:25:30 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f4def86f-9be6-47d8-9bb2-207572c0b5ca tempest-VolumesDeleteCascade-2136533043 None] Create snapshot completed successfully Jul 14 20:25:31 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d 1073741824" returned: 0 in 0.604s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:31 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d Jul 14 20:25:31 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:31 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.744s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006165680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8f00e3-4625-4ff0-9921-630bcf1711a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c5bccd5aa443d83a72bc4b0fd9da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:26Z,use_quota=True,user_id='2174aba48cb64a519fc7c80d72f79d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Creating volume fa8f00e3-4625-4ff0-9921-630bcf1711a0 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:31 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:31 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 1073741824 Jul 14 20:25:31 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef7287-fe5f-441a-b632-fe385981e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb07152-8c96-4114-8590-6da3a963175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:32 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Volume volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d (a1157a21-8e98-4cae-9ebd-cc22bb09229d): created successfully Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb07152-8c96-4114-8590-6da3a963175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (7a2516b0-8660-443d-a2a0-c07851077147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d294899f-309d-4751-a942-9a7d4445303f tempest-CreateVolumesFromImageTest-171050571 None] Created volume successfully. Jul 14 20:25:32 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 1073741824" returned: 0 in 0.815s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:32 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 Jul 14 20:25:32 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (b37483ba-deff-4933-9898-4ce8058a1029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1966bf2a-96c8-43b0-bf34-98f523047d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1966bf2a-96c8-43b0-bf34-98f523047d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1586885179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8bcb592-2370-4ee3-99eb-9a3df7f17109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4877406d63704c139bf3ce88804408c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=793fa0a2-8728-47d3-bfe9-d356f65145f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:33Z,use_quota=True,user_id='0082a75340d546d6957e9f52a3c8c6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05d8775-2f61-4a73-9ec5-c54354589a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05d8775-2f61-4a73-9ec5-c54354589a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b868fbf-6817-490d-9c55-41d7da92b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:32 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b868fbf-6817-490d-9c55-41d7da92b25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8bcb592-2370-4ee3-99eb-9a3df7f17109', 'volume_name': 'volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109', 'volume_size': 1, 'snapshot_id': '793fa0a2-8728-47d3-bfe9-d356f65145f5'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d92ddb-bb02-4ddc-9b62-11772933b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d92ddb-bb02-4ddc-9b62-11772933b127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4a495-0af4-47d6-a12d-31e521943c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:33 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Volume d8bcb592-2370-4ee3-99eb-9a3df7f17109: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109', 'volume_size': 1, 'snapshot_id': '793fa0a2-8728-47d3-bfe9-d356f65145f5'} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:33 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0" returned: 0 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.161s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5-d8bcb592-2370-4ee3-99eb-9a3df7f17109" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f64675-3fc3-4637-b3c2-6255741e2f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310339b9-f44d-4341-89d2-773aeeddf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5-d8bcb592-2370-4ee3-99eb-9a3df7f17109" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Creating volume d8bcb592-2370-4ee3-99eb-9a3df7f17109 from snapshot 793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:33 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Volume volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 (fa8f00e3-4625-4ff0-9921-630bcf1711a0): created successfully Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310339b9-f44d-4341-89d2-773aeeddf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Flow 'volume_create_manager' (111b87a6-0df9-4703-8d80-be23f71adccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] snapshot: 793fa0a2-8728-47d3-bfe9-d356f65145f5, volume: d8bcb592-2370-4ee3-99eb-9a3df7f17109, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:25:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-22411a4b-12c5-419a-b5b9-0dab56191cf2 tempest-CreateVolumesFromImageTest-171050571 None] Created volume successfully. Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a03f4-da07-4211-8d34-919a9e0b62f8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:33 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:33 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-fa8f00e3-4625-4ff0-9921-630bcf1711a0-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-fa8f00e3-4625-4ff0-9921-630bcf1711a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:34 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.788s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202c87e3-5118-4c95-a223-cada8c09c7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-quobyte-fa8f00e3-4625-4ff0-9921-630bcf1711a0" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c532c-c120-4495-8509-7cc913853116]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-fa8f00e3-4625-4ff0-9921-630bcf1711a0" acquired by "delete_volume" :: waited 0.059s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcfc323-e32b-4dc2-aea9-515090382aea]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:34 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:34 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:34 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 Jul 14 20:25:34 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:34 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.582s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:25:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:34 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 Jul 14 20:25:34 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:35 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0" returned: 0 in 0.702s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:35 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0 Jul 14 20:25:35 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:35 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fa8f00e3-4625-4ff0-9921-630bcf1711a0" returned: 0 in 0.696s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-fa8f00e3-4625-4ff0-9921-630bcf1711a0" released by "delete_volume" :: held 1.483s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Created reservations ['234732fb-d1ac-41e9-b11b-ddc573f1f2d8', 'd13ee392-fa07-4a10-bde4-203ec4db9fc1', 'bdee6925-e92e-4247-8380-0fbd6ae975b4', 'a530bde8-c04d-4c7a-8ec6-712bea723f6b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:36 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:36 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-a1157a21-8e98-4cae-9ebd-cc22bb09229d-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-a1157a21-8e98-4cae-9ebd-cc22bb09229d-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-quobyte-a1157a21-8e98-4cae-9ebd-cc22bb09229d" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-a1157a21-8e98-4cae-9ebd-cc22bb09229d" acquired by "delete_volume" :: waited 0.069s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:37 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 1.094s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e26e9f0-e917-477d-bc24-3c9253646002]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Deleted volume successfully. Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-73ca2f5b-b574-4d6e-9d87-d0594a2f0c0e tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-fa8f00e3-4625-4ff0-9921-630bcf1711a0-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:37 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d Jul 14 20:25:37 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:38 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d" returned: 0 in 1.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:39 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d Jul 14 20:25:39 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:39 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a1157a21-8e98-4cae-9ebd-cc22bb09229d" returned: 0 in 0.650s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-a1157a21-8e98-4cae-9ebd-cc22bb09229d" released by "delete_volume" :: held 2.238s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Created reservations ['b43f88b1-5810-4d3a-b04e-dfe4a582177e', '9e508f6e-7efa-46c3-a5d9-d9dea20bb5aa', '3081f95d-43d5-40c6-bdda-49f18e462aa1', '3cf8d2d5-5f4e-4e9d-9cc6-d246c5f51163'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:40 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:40 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:40 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.942s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:40 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Deleted volume successfully. Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af773000-488f-4ba3-b7b3-566953bd6c7c tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-a1157a21-8e98-4cae-9ebd-cc22bb09229d-delete_volume" released by "delete_volume" :: held 4.017s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-44408478-e948-4f8f-b8c3-0e0fd10fc12f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-44408478-e948-4f8f-b8c3-0e0fd10fc12f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-quobyte-44408478-e948-4f8f-b8c3-0e0fd10fc12f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-44408478-e948-4f8f-b8c3-0e0fd10fc12f" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcadc7cd-46f8-4631-a09a-caf08b7c3807]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:42 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f Jul 14 20:25:42 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:43 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f" returned: 0 in 1.592s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:43 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f Jul 14 20:25:43 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:43 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109" returned: 0 in 8.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b840fa1-b7b5-4fee-b370-7dea4bf571be]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:43 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:43 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Flow 'volume_create_manager' (5d63ae62-8562-49d7-a389-c53042d5c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747756b0-f6c0-420e-9d8a-68e00eaedbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747756b0-f6c0-420e-9d8a-68e00eaedbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1639832135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979bd08e-1fd6-405c-814a-46f2aac3f0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0741d7ad12c24875a21eaa98d624290c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:43Z,use_quota=True,user_id='bf4c054623b9404d8c083322757b71d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bb6d02-59c9-4da0-953d-fde63f761be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bb6d02-59c9-4da0-953d-fde63f761be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef34ce2-4f32-4e13-b76c-3fcc80f9f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef34ce2-4f32-4e13-b76c-3fcc80f9f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979bd08e-1fd6-405c-814a-46f2aac3f0f5', 'volume_name': 'volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f779fb5c-4f83-48a3-bfc6-2e9e842df6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f779fb5c-4f83-48a3-bfc6-2e9e842df6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124701e2-df7f-4085-959d-ac9313c719b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:43 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Volume 979bd08e-1fd6-405c-814a-46f2aac3f0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5', 'volume_size': 1} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:43 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-44408478-e948-4f8f-b8c3-0e0fd10fc12f" returned: 0 in 0.452s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-44408478-e948-4f8f-b8c3-0e0fd10fc12f" released by "delete_volume" :: held 2.165s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Created reservations ['924cace3-787a-42b3-b8fb-48358e6478dd', 'a43d3d5e-760b-4efc-a04c-083b7a03668b', '78112ecb-2c69-4511-8630-e55abe3f3e44', '7f14c4dd-5064-4c9e-b5fa-3c4cf6c8a095'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:43 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:43 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-c46213d0-5861-4de7-b904-5a690aa170d7-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-c46213d0-5861-4de7-b904-5a690aa170d7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-quobyte-c46213d0-5861-4de7-b904-5a690aa170d7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-c46213d0-5861-4de7-b904-5a690aa170d7" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:44 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8b639-d83c-446e-8ac0-5b16cc5d798d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.889s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:25:44 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Converted 1024.00 MB image at 122.18 MB/s Jul 14 20:25:44 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 is being set with open permissions: ugo+rw Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:44 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 Jul 14 20:25:44 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:44 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.494s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Deleted volume successfully. Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2fccc290-fec3-44aa-90a5-65651229fd34 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-44408478-e948-4f8f-b8c3-0e0fd10fc12f-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:44 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 Jul 14 20:25:44 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:44 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" released by "_copy_volume_from_snapshot" :: held 11.219s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5-d8bcb592-2370-4ee3-99eb-9a3df7f17109" released by "_create_volume_from_snapshot" :: held 11.273s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.317s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1639832135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979bd08e-1fd6-405c-814a-46f2aac3f0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0741d7ad12c24875a21eaa98d624290c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:43Z,use_quota=True,user_id='bf4c054623b9404d8c083322757b71d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Creating volume 979bd08e-1fd6-405c-814a-46f2aac3f0f5 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:44 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:44 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 1073741824 Jul 14 20:25:44 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4a495-0af4-47d6-a12d-31e521943c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109', 'volume_size': 1, 'snapshot_id': '793fa0a2-8728-47d3-bfe9-d356f65145f5'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7d1331-26c7-4eaf-84ef-5e8a297df410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:44 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Volume volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 (d8bcb592-2370-4ee3-99eb-9a3df7f17109): created successfully Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7d1331-26c7-4eaf-84ef-5e8a297df410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Flow 'volume_create_manager' (b37483ba-deff-4933-9898-4ce8058a1029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5326f04a-da57-422e-aff3-33802da0b5c9 tempest-VolumesDeleteCascade-2136533043 None] Created volume successfully. Jul 14 20:25:44 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7" returned: 0 in 0.665s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:44 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7 Jul 14 20:25:44 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:45 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c46213d0-5861-4de7-b904-5a690aa170d7" returned: 0 in 0.328s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-c46213d0-5861-4de7-b904-5a690aa170d7" released by "delete_volume" :: held 1.070s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:45 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 1073741824" returned: 0 in 0.667s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Created reservations ['b3ce738f-191b-4f5c-8ffd-77287096d22c', 'beedd6d8-9dcf-4490-83d1-6b3ba8e2a053', 'd1dae289-b672-4d99-8f05-62a1a21e7df2', 'f75a273e-e04d-4b8b-8762-de514df0cd2a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:45 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 Jul 14 20:25:45 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-202c87e3-5118-4c95-a223-cada8c09c7ce-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-202c87e3-5118-4c95-a223-cada8c09c7ce-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:45 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:45 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Performing cascade delete. {{(pid=87600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-793fa0a2-8728-47d3-bfe9-d356f65145f5-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-793fa0a2-8728-47d3-bfe9-d356f65145f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Deleting offline snapshot 793fa0a2-8728-47d3-bfe9-d356f65145f5 of volume 202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] snapshot_file for this snap is: volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3363968c-1871-471f-a1e4-bf8175c308a0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:45 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5" returned: 0 in 0.565s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124701e2-df7f-4085-959d-ac9313c719b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca76b5-1367-4779-a1bf-9f917093204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Volume volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 (979bd08e-1fd6-405c-814a-46f2aac3f0f5): created successfully Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca76b5-1367-4779-a1bf-9f917093204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Flow 'volume_create_manager' (5d63ae62-8562-49d7-a389-c53042d5c28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-61a3b34e-c48b-48e3-88f9-f133151ba1d6 tempest-TestMinimumBasicScenario-851218135 None] Created volume successfully. Jul 14 20:25:45 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:45 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:45 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Deleted volume successfully. Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7b004be-fcc1-40db-a457-b1a9c538cac7 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-c46213d0-5861-4de7-b904-5a690aa170d7-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-607ff001-e26b-4203-983d-78ccaf3a1ebf-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-607ff001-e26b-4203-983d-78ccaf3a1ebf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:46 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.596s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202c87e3-5118-4c95-a223-cada8c09c7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e0ac1-c3bf-410b-82e3-ff9d97796bdc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "cinder-quobyte-607ff001-e26b-4203-983d-78ccaf3a1ebf" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-607ff001-e26b-4203-983d-78ccaf3a1ebf" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8dfaa1-8c80-4acf-a04d-63941b399bae]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:46 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:46 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:46 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf Jul 14 20:25:46 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:46 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.591s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:47 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:47 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:47 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf" returned: 0 in 0.816s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:47 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf Jul 14 20:25:47 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:47 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.607s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:47 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5 Jul 14 20:25:47 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:47 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-607ff001-e26b-4203-983d-78ccaf3a1ebf" returned: 0 in 0.473s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-quobyte-607ff001-e26b-4203-983d-78ccaf3a1ebf" released by "delete_volume" :: held 1.359s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:47 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Created reservations ['3bb467e1-e0b0-47b8-a1ad-50f597f941c1', 'f272c6b1-c21e-4ed2-8d49-cd6cd65f26d1', '70735b8e-ff75-4f9f-a185-528253ddc8d0', '88466812-2fbd-4800-95d9-f2726f15783e'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:48 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce.793fa0a2-8728-47d3-bfe9-d356f65145f5" returned: 0 in 0.533s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:48 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:48 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-793fa0a2-8728-47d3-bfe9-d356f65145f5" released by "_delete_snapshot" :: held 2.513s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" released by "delete_snapshot" :: held 2.564s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['f6994ec1-9702-4ac0-8c9f-a2befcc72a11', '3e69b313-875a-458a-b837-49bd4bcad2d3', '2127e0e1-f74e-49f7-8ac1-e609e0c98642', '944d5006-2aa9-409c-8a98-1c4ea85309c0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Delete snapshot completed successfully. Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-793fa0a2-8728-47d3-bfe9-d356f65145f5-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Snapshots deleted, issuing volume delete {{(pid=87600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:48 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.433s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec9bc4c-14d8-4ea5-aa67-978f9267c555]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Deleted volume successfully. Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-71640db7-b71f-4a43-bce8-27676e2aaf60 tempest-CreateVolumesFromImageTest-171050571 None] Lock "cinder-607ff001-e26b-4203-983d-78ccaf3a1ebf-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:48 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:48 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3422a56-c25e-4930-9ed1-5067a8263974]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:49 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 Jul 14 20:25:49 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:49 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.521s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:49 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce Jul 14 20:25:49 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:49 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5" returned: 0 in 0.496s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.518s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7061ae1b-863d-4e78-b070-ec01f98efcef', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:25:49 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-202c87e3-5118-4c95-a223-cada8c09c7ce" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-202c87e3-5118-4c95-a223-cada8c09c7ce" released by "delete_volume" :: held 0.955s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-5fbae2c4-b75f-484e-b2a7-3fc1e3955fc3 req-6d27ec29-c247-437c-bfba-f3f107618775 tempest-TestMinimumBasicScenario-851218135 None] attachment_update completed successfully. Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['d651dbc0-3127-451d-b7c8-6a292110a370', '4c08fd18-0c01-460e-89f0-d1eee894ddaa', '208070fe-cb4f-449b-8614-032fc9878442', '352b01f8-2e6e-496f-9760-ee5d4758364c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:49 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:49 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:49 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Deleted volume successfully. Jul 14 20:25:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f233e631-bfa7-447f-9ee5-de1cfdebce90 tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-202c87e3-5118-4c95-a223-cada8c09c7ce-delete_volume" released by "delete_volume" :: held 4.541s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-d8bcb592-2370-4ee3-99eb-9a3df7f17109-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-d8bcb592-2370-4ee3-99eb-9a3df7f17109-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" acquired by "delete_volume" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed6b63f-5e88-4755-ac30-7893e0e89edd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:50 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 Jul 14 20:25:50 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:50 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:50 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109 Jul 14 20:25:50 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:51 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d8bcb592-2370-4ee3-99eb-9a3df7f17109" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-quobyte-d8bcb592-2370-4ee3-99eb-9a3df7f17109" released by "delete_volume" :: held 0.750s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Created reservations ['7f2056e7-2708-4225-a259-9503234f80e0', 'a4c96b9a-68b4-4697-9b9e-e7326cee9bf1', '93013ec3-f14a-484b-9cc7-96ddd91dea36', 'ac47f254-b408-4848-bbc4-ce9c9ce87bd1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:51 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:51 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:51 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Deleted volume successfully. Jul 14 20:25:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-760486bf-eaea-4e00-9a03-1bfdcc5bc01c tempest-VolumesDeleteCascade-2136533043 None] Lock "cinder-d8bcb592-2370-4ee3-99eb-9a3df7f17109-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Flow 'volume_create_manager' (fe6acbe2-5045-49ca-94cc-4a6f264254cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c8dac1-d487-43d7-a04c-cce9816b3412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c8dac1-d487-43d7-a04c-cce9816b3412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235036939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ff5eb3-30dc-4a83-ba73-36b5246021a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c24a734c144d46b6396300c7482589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:54Z,use_quota=True,user_id='12e9e526dfdb4f36baadaca413acd5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0900e5b-f13f-41aa-878a-2530609d5cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0900e5b-f13f-41aa-878a-2530609d5cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404f7507-daa7-400c-99f9-cdca37b50b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404f7507-daa7-400c-99f9-cdca37b50b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61ff5eb3-30dc-4a83-ba73-36b5246021a9', 'volume_name': 'volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d7723a-c506-4af7-ae7e-7be0ce662bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d7723a-c506-4af7-ae7e-7be0ce662bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a701efad-79d8-4d1d-91d0-a4e9303c847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Volume 61ff5eb3-30dc-4a83-ba73-36b5246021a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9', 'volume_size': 1} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235036939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ff5eb3-30dc-4a83-ba73-36b5246021a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c24a734c144d46b6396300c7482589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:54Z,use_quota=True,user_id='12e9e526dfdb4f36baadaca413acd5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Creating volume 61ff5eb3-30dc-4a83-ba73-36b5246021a9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:53 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:53 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 1073741824 Jul 14 20:25:53 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:54 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 1073741824" returned: 0 in 0.663s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:54 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 Jul 14 20:25:54 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:55 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9" returned: 0 in 0.535s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a701efad-79d8-4d1d-91d0-a4e9303c847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a680d4b-5fae-46ef-8631-090a598b17ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Volume volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 (61ff5eb3-30dc-4a83-ba73-36b5246021a9): created successfully Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a680d4b-5fae-46ef-8631-090a598b17ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Flow 'volume_create_manager' (fe6acbe2-5045-49ca-94cc-4a6f264254cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ac2b3117-b94c-40ac-8252-b0255140a02c tempest-ProjectReaderTests-1536393471 None] Created volume successfully. Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Flow 'volume_create_manager' (efa477c9-a677-48a2-988f-bb9544c4b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d50c1d-bae4-43a1-bb26-ad7d8c38595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d50c1d-bae4-43a1-bb26-ad7d8c38595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1171869119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7fd2c2-09e1-44ed-a3fe-eb81eab46492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cecccd44b4848968c1d5394ee67fe57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:56Z,use_quota=True,user_id='367c63a5c04b4584bf928650f4092ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32f7de9-9fac-487e-b68e-bd5ea49303bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32f7de9-9fac-487e-b68e-bd5ea49303bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e657f986-d87d-4f28-8923-0f01bf3fe9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e657f986-d87d-4f28-8923-0f01bf3fe9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7fd2c2-09e1-44ed-a3fe-eb81eab46492', 'volume_name': 'volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc99804-87c2-4d59-8f3b-1f90d197930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc99804-87c2-4d59-8f3b-1f90d197930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157c040f-e2e5-460e-a6c0-e88bae85334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Volume 7b7fd2c2-09e1-44ed-a3fe-eb81eab46492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492', 'volume_size': 1} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1171869119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7fd2c2-09e1-44ed-a3fe-eb81eab46492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cecccd44b4848968c1d5394ee67fe57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:25:56Z,use_quota=True,user_id='367c63a5c04b4584bf928650f4092ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Creating volume 7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:25:55 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:25:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:55 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 1073741824 Jul 14 20:25:55 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "cinder-61ff5eb3-30dc-4a83-ba73-36b5246021a9-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-61ff5eb3-30dc-4a83-ba73-36b5246021a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "cinder-quobyte-61ff5eb3-30dc-4a83-ba73-36b5246021a9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-quobyte-61ff5eb3-30dc-4a83-ba73-36b5246021a9" acquired by "delete_volume" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[24318a05-d2e1-4c7e-bf80-cae57590b860]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:56 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 1073741824" returned: 0 in 0.911s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:56 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 Jul 14 20:25:56 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:56 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 Jul 14 20:25:56 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:57 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9" returned: 0 in 0.602s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:57 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9 Jul 14 20:25:57 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" returned: 0 in 0.615s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:57 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157c040f-e2e5-460e-a6c0-e88bae85334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2388ed6-982b-4acd-a45a-a4e48d815ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:57 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Volume volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 (7b7fd2c2-09e1-44ed-a3fe-eb81eab46492): created successfully Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2388ed6-982b-4acd-a45a-a4e48d815ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Flow 'volume_create_manager' (efa477c9-a677-48a2-988f-bb9544c4b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e579424d-9536-45b6-80b7-b512a2957248 tempest-SnapshotMetadataTestJSON-523543664 None] Created volume successfully. Jul 14 20:25:57 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-61ff5eb3-30dc-4a83-ba73-36b5246021a9" returned: 0 in 0.433s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-quobyte-61ff5eb3-30dc-4a83-ba73-36b5246021a9" released by "delete_volume" :: held 1.126s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Created reservations ['51956ff7-269c-415c-81d6-d6f90b9d1985', 'ce7982be-0a28-480a-93dd-155d5baf8e09', 'e3673517-7ced-48d7-826c-06a07a5d59c9', 'c7f528d4-78b5-4efa-995e-801961a52aa9'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:25:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:57 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:25:57 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Creating offline snapshot 76ea9cdf-4f9f-4350-b101-f5704d75604c of volume 7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:25:58 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.405s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c5cd4-c1ac-4722-b159-421e370d4a33]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Deleted volume successfully. Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8578f891-efeb-4d53-befc-6cc6c1663e92 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-61ff5eb3-30dc-4a83-ba73-36b5246021a9-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:25:58 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 Jul 14 20:25:58 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:58 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" returned: 0 in 0.565s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:58 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c 1G Jul 14 20:25:58 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:59 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c 1G" returned: 0 in 0.674s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:25:59 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c Jul 14 20:25:59 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Flow 'volume_create_manager' (40518d58-2cce-49a4-a0ca-e0c60fa1b651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa026a-516e-40b0-ae77-6a5bbf39155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa026a-516e-40b0-ae77-6a5bbf39155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148494656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212eee21-15c3-4009-a425-bcfdc9eaba78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c24a734c144d46b6396300c7482589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:00Z,use_quota=True,user_id='12e9e526dfdb4f36baadaca413acd5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990bed5e-fb9e-4855-95c3-936946c9ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990bed5e-fb9e-4855-95c3-936946c9ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e0ec8-5ee7-4740-8155-3f2efc906f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e0ec8-5ee7-4740-8155-3f2efc906f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212eee21-15c3-4009-a425-bcfdc9eaba78', 'volume_name': 'volume-212eee21-15c3-4009-a425-bcfdc9eaba78', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15453dd3-effd-47d8-9138-2a09d707b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15453dd3-effd-47d8-9138-2a09d707b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da61d31b-cd89-4f58-b5e0-608ce4c282ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:25:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Volume 212eee21-15c3-4009-a425-bcfdc9eaba78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212eee21-15c3-4009-a425-bcfdc9eaba78', 'volume_size': 1} Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:25:59 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 14 20:25:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:25:59 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c is being set with open permissions: ugo+rw Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:00 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c Jul 14 20:26:00 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:00 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c" returned: 0 in 0.343s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:00 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info Jul 14 20:26:00 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:00 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info" returned: 0 in 0.288s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:00 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info is being set with open permissions: ugo+rw Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:00 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info Jul 14 20:26:00 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:00 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.info" returned: 0 in 0.296s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148494656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212eee21-15c3-4009-a425-bcfdc9eaba78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c24a734c144d46b6396300c7482589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:00Z,use_quota=True,user_id='12e9e526dfdb4f36baadaca413acd5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Creating volume 212eee21-15c3-4009-a425-bcfdc9eaba78 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:26:01 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:01 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 1073741824 Jul 14 20:26:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6780a9dc-f455-4b2a-896d-0ace042f6a7b tempest-SnapshotMetadataTestJSON-523543664 None] Create snapshot completed successfully Jul 14 20:26:01 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:01 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 1073741824" returned: 0 in 0.596s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:01 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 Jul 14 20:26:01 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:01 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da61d31b-cd89-4f58-b5e0-608ce4c282ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212eee21-15c3-4009-a425-bcfdc9eaba78', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e1b8c1-d115-459e-9046-931de0e14133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Volume volume-212eee21-15c3-4009-a425-bcfdc9eaba78 (212eee21-15c3-4009-a425-bcfdc9eaba78): created successfully Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e1b8c1-d115-459e-9046-931de0e14133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Flow 'volume_create_manager' (40518d58-2cce-49a4-a0ca-e0c60fa1b651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7c483f52-5052-455d-98b9-6077d80c6e1f tempest-ProjectReaderTests-1536393471 None] Created volume successfully. Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "cinder-76ea9cdf-4f9f-4350-b101-f5704d75604c-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-76ea9cdf-4f9f-4350-b101-f5704d75604c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "cinder-quobyte-76ea9cdf-4f9f-4350-b101-f5704d75604c" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-76ea9cdf-4f9f-4350-b101-f5704d75604c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Deleting offline snapshot 76ea9cdf-4f9f-4350-b101-f5704d75604c of volume 7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] snapshot_file for this snap is: volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261a823-f600-4ef4-8698-f874eeebac38]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:02 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c Jul 14 20:26:02 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "cinder-212eee21-15c3-4009-a425-bcfdc9eaba78-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-212eee21-15c3-4009-a425-bcfdc9eaba78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "cinder-quobyte-212eee21-15c3-4009-a425-bcfdc9eaba78" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-quobyte-212eee21-15c3-4009-a425-bcfdc9eaba78" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:03 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480f9ff-b078-403a-ba97-aa4ff694ef1c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c" returned: 0 in 0.523s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8afe54b-9068-4886-8440-f20a1f79f15b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:03 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 Jul 14 20:26:03 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:03 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 Jul 14 20:26:03 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:03 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:03 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:03 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78" returned: 0 in 0.518s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:03 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78 Jul 14 20:26:03 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:03 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" returned: 0 in 0.586s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:03 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.410s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:26:03 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:26:03 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:03 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-212eee21-15c3-4009-a425-bcfdc9eaba78" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-quobyte-212eee21-15c3-4009-a425-bcfdc9eaba78" released by "delete_volume" :: held 0.959s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Created reservations ['12eac050-72cf-46ce-a8e9-7fbfc65ff34a', 'b74185d1-f5a8-485d-9da1-0c5cb1b913f5', '20c2f6e5-de44-46ab-adc4-73ab5e974465', 'b2142956-ba04-403e-9c5c-60c11ee552d1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:04 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c" returned: 0 in 0.447s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:04 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c Jul 14 20:26:04 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:04 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:04 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:04 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492.76ea9cdf-4f9f-4350-b101-f5704d75604c" returned: 0 in 0.440s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:04 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.316s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-76ea9cdf-4f9f-4350-b101-f5704d75604c" released by "_delete_snapshot" :: held 2.190s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Deleted volume successfully. Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" released by "delete_snapshot" :: held 2.222s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-91093aa0-a23f-4cf2-af89-0a29cfe5a233 tempest-ProjectReaderTests-1536393471 None] Lock "cinder-212eee21-15c3-4009-a425-bcfdc9eaba78-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Created reservations ['b8d1b7df-0c88-4eaa-8840-ab2e18fb2b0e', 'ba604476-3137-427f-8f38-3da780650ac8', '767995be-642a-4a50-8076-9630c215fc31', '6e2ef6e0-07d9-4ccc-8c20-539b06099f42'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Delete snapshot completed successfully. Jul 14 20:26:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d3be18a3-d3f8-4fcd-a5bd-34ac52a536e7 tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-76ea9cdf-4f9f-4350-b101-f5704d75604c-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "cinder-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05e68fb-a9d7-4a4f-9b62-149eaba6c198]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:06 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 Jul 14 20:26:06 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:06 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:06 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492 Jul 14 20:26:06 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:06 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-quobyte-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492" released by "delete_volume" :: held 0.909s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:06 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Created reservations ['0b65263c-9445-4056-80fe-fd2f89d30fca', 'a37548f3-e0fd-4dda-9ee3-7f16cd7d35bc', 'f4234460-abcd-4b28-ba90-d43b5c65f933', '98814e60-65b6-4a17-aebf-66dbe5c35493'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:07 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:07 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:07 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Deleted volume successfully. Jul 14 20:26:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9bbc8622-e131-4e38-b526-21ec894a23aa tempest-SnapshotMetadataTestJSON-523543664 None] Lock "cinder-7b7fd2c2-09e1-44ed-a3fe-eb81eab46492-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Flow 'volume_create_manager' (d18a77d3-abc7-4651-bda3-d0f090fd6f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3e3039-bf90-44ae-a792-e41e2972896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3e3039-bf90-44ae-a792-e41e2972896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704687749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622714b8-cd99-4d8f-85d8-2eeb41374570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960849a37a7c46d6af3bf54701daac94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:08Z,use_quota=True,user_id='3d40d6d20a51433d9090cea9b53ed461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c08f9a-784b-4e3a-9420-c6ade1d94a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c08f9a-784b-4e3a-9420-c6ade1d94a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae5a114-b283-4729-88e6-4a6b31b8f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae5a114-b283-4729-88e6-4a6b31b8f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622714b8-cd99-4d8f-85d8-2eeb41374570', 'volume_name': 'volume-622714b8-cd99-4d8f-85d8-2eeb41374570', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad84d00e-d73a-4b9c-b1df-b04968ac7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad84d00e-d73a-4b9c-b1df-b04968ac7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8f0197-66ab-46ab-91f8-f7978dcb6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Volume 622714b8-cd99-4d8f-85d8-2eeb41374570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622714b8-cd99-4d8f-85d8-2eeb41374570', 'volume_size': 1} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1704687749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622714b8-cd99-4d8f-85d8-2eeb41374570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960849a37a7c46d6af3bf54701daac94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:08Z,use_quota=True,user_id='3d40d6d20a51433d9090cea9b53ed461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Creating volume 622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:26:08 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:08 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 1073741824 Jul 14 20:26:08 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:08 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 1073741824" returned: 0 in 0.646s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:08 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:26:08 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:09 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8f0197-66ab-46ab-91f8-f7978dcb6aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622714b8-cd99-4d8f-85d8-2eeb41374570', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03a08d-061e-4c4b-bc3d-9655a6217df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:09 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Volume volume-622714b8-cd99-4d8f-85d8-2eeb41374570 (622714b8-cd99-4d8f-85d8-2eeb41374570): created successfully Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03a08d-061e-4c4b-bc3d-9655a6217df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Flow 'volume_create_manager' (d18a77d3-abc7-4651-bda3-d0f090fd6f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-df3f3fc1-f3fc-4622-8180-8c374521216e tempest-VolumesActionsTest-2102197392 None] Created volume successfully. Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Flow 'volume_create_manager' (e40c3f11-522e-46be-bd83-332aa37c0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c5fa3-7aeb-45cd-acf6-86a48e0f0de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c5fa3-7aeb-45cd-acf6-86a48e0f0de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1358889083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6219d17-6a8e-4c1a-baac-5bedccd695f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc253f1864a4099aa5008eff42397c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:18Z,use_quota=True,user_id='c76ae949a9074ff9bad9e444bf47bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8112df-a81c-40ac-8047-7c9815c6dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8112df-a81c-40ac-8047-7c9815c6dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7722e2-602d-409c-8520-36c63c3132a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7722e2-602d-409c-8520-36c63c3132a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6219d17-6a8e-4c1a-baac-5bedccd695f9', 'volume_name': 'volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5d7cc6-6a67-4b92-b4b2-d2c53535383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5d7cc6-6a67-4b92-b4b2-d2c53535383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b7f023-4ea7-41d6-9176-dbb0edb4f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:18 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Volume e6219d17-6a8e-4c1a-baac-5bedccd695f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9', 'volume_size': 1} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1358889083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6219d17-6a8e-4c1a-baac-5bedccd695f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc253f1864a4099aa5008eff42397c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:18Z,use_quota=True,user_id='c76ae949a9074ff9bad9e444bf47bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Creating volume e6219d17-6a8e-4c1a-baac-5bedccd695f9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:26:18 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:26:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:18 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 1073741824 Jul 14 20:26:18 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:19 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 1073741824" returned: 0 in 0.912s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:19 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 Jul 14 20:26:19 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:19 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9" returned: 0 in 0.440s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b7f023-4ea7-41d6-9176-dbb0edb4f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a9ba06-ffd8-42cc-9e4e-3cf7434d44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:19 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Volume volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 (e6219d17-6a8e-4c1a-baac-5bedccd695f9): created successfully Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a9ba06-ffd8-42cc-9e4e-3cf7434d44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Flow 'volume_create_manager' (e40c3f11-522e-46be-bd83-332aa37c0b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-affd188b-797f-4ab1-893e-292cb9d1f6ba tempest-VolumesMetadataTest-1339754082 None] Created volume successfully. Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d896c14c-b0e0-40e2-9c75-14d8af058eab tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" by "attach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d896c14c-b0e0-40e2-9c75-14d8af058eab tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" acquired by "attach_volume" :: waited 0.039s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Acquiring lock "cinder-e6219d17-6a8e-4c1a-baac-5bedccd695f9-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "cinder-e6219d17-6a8e-4c1a-baac-5bedccd695f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d896c14c-b0e0-40e2-9c75-14d8af058eab tempest-VolumesActionsTest-2102197392 None] Attaching volume 622714b8-cd99-4d8f-85d8-2eeb41374570 to instance b663c3cf-0394-4a7f-81d9-7ca915e93c80 at mountpoint /dev/vdb on host None. Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Acquiring lock "cinder-quobyte-e6219d17-6a8e-4c1a-baac-5bedccd695f9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d896c14c-b0e0-40e2-9c75-14d8af058eab tempest-VolumesActionsTest-2102197392 None] Attach volume completed successfully. Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "cinder-quobyte-e6219d17-6a8e-4c1a-baac-5bedccd695f9" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d896c14c-b0e0-40e2-9c75-14d8af058eab tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" released by "attach_volume" :: held 0.232s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9319a99-68ef-4c65-b5c1-93ffe11c38dd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af415b91-14da-421b-9d36-7a2087b29e94 tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" by "detach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af415b91-14da-421b-9d36-7a2087b29e94 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-af415b91-14da-421b-9d36-7a2087b29e94 tempest-VolumesActionsTest-2102197392 None] Detaching volume 622714b8-cd99-4d8f-85d8-2eeb41374570 from instance b663c3cf-0394-4a7f-81d9-7ca915e93c80. Jul 14 20:26:21 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 Jul 14 20:26:21 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-af415b91-14da-421b-9d36-7a2087b29e94 tempest-VolumesActionsTest-2102197392 None] Detach volume completed successfully. Jul 14 20:26:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-af415b91-14da-421b-9d36-7a2087b29e94 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:22 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9" returned: 0 in 0.528s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:22 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9 Jul 14 20:26:22 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:22 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6219d17-6a8e-4c1a-baac-5bedccd695f9" returned: 0 in 0.667s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "cinder-quobyte-e6219d17-6a8e-4c1a-baac-5bedccd695f9" released by "delete_volume" :: held 1.280s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:22 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Created reservations ['72b53898-1ec5-4122-a71c-8696917f52fa', 'dab17014-116e-410c-8870-f6725afd73be', '22f812e4-ed40-4c30-acb2-ce08eee71da7', '5332b98b-31f0-4e03-8be7-ed6ccef28eaf'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:23 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:23 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:23 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.541s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Deleted volume successfully. Jul 14 20:26:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4fb5c1c0-fe84-4f8a-a2a7-290a272497a1 tempest-VolumesMetadataTest-1339754082 None] Lock "cinder-e6219d17-6a8e-4c1a-baac-5bedccd695f9-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=158,cinder:SELECT=117,cinder:DELETE=17,cinder:INSERT=37 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=115,cinder:UPDATE=149,cinder:INSERT=35,cinder:DELETE=11 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Flow 'volume_create_manager' (d0cdc07d-65dd-47d6-97eb-d364f6fa73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cb0dab-aed9-4271-9a53-9218fde3bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cb0dab-aed9-4271-9a53-9218fde3bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1391863072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31c1392-2585-44c1-9c00-56179bf649aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec4b0f844342a18294e1e86199a95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:29Z,use_quota=True,user_id='c3240ddffb2649338f9af5295b25e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbd366-8556-499f-9cee-bdbbe1909c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbd366-8556-499f-9cee-bdbbe1909c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad35a66b-7855-435e-bb70-2358058afc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad35a66b-7855-435e-bb70-2358058afc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31c1392-2585-44c1-9c00-56179bf649aa', 'volume_name': 'volume-e31c1392-2585-44c1-9c00-56179bf649aa', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817d40d4-8e0c-4161-b72d-dfa248e062e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817d40d4-8e0c-4161-b72d-dfa248e062e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf95141-95e9-4258-983b-0764c44602f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Volume e31c1392-2585-44c1-9c00-56179bf649aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31c1392-2585-44c1-9c00-56179bf649aa', 'volume_size': 1} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1391863072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31c1392-2585-44c1-9c00-56179bf649aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec4b0f844342a18294e1e86199a95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:29Z,use_quota=True,user_id='c3240ddffb2649338f9af5295b25e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Creating volume e31c1392-2585-44c1-9c00-56179bf649aa {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:26:29 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:26:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:29 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa 1073741824 Jul 14 20:26:29 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:30 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa 1073741824" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:30 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa Jul 14 20:26:30 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:30 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf95141-95e9-4258-983b-0764c44602f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31c1392-2585-44c1-9c00-56179bf649aa', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ebf6a8-e6d0-4ebf-9878-64dc46b09810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Volume volume-e31c1392-2585-44c1-9c00-56179bf649aa (e31c1392-2585-44c1-9c00-56179bf649aa): created successfully Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ebf6a8-e6d0-4ebf-9878-64dc46b09810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Flow 'volume_create_manager' (d0cdc07d-65dd-47d6-97eb-d364f6fa73bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-050e5026-702f-4046-8597-05893bcfa474 tempest-VolumesTransfersV355Test-1529068378 None] Created volume successfully. Jul 14 20:26:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2107d5ca-0bf2-4205-b0b6-83c3ebe72477 tempest-VolumesTransfersV355Test-1186296000 None] Transfer volume completed successfully. Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "cinder-e31c1392-2585-44c1-9c00-56179bf649aa-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-e31c1392-2585-44c1-9c00-56179bf649aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "cinder-quobyte-e31c1392-2585-44c1-9c00-56179bf649aa" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-quobyte-e31c1392-2585-44c1-9c00-56179bf649aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[14489f69-1196-4ac8-8612-187888f0a127]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:32 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa Jul 14 20:26:32 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:32 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:32 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa Jul 14 20:26:32 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:32 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e31c1392-2585-44c1-9c00-56179bf649aa" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-quobyte-e31c1392-2585-44c1-9c00-56179bf649aa" released by "delete_volume" :: held 0.704s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Created reservations ['7435bde7-e5bd-4b09-bb19-3d8d581d1bbc', 'd238f45c-5955-42f8-b8b1-71fce158e750', '7917cc76-2822-4559-95f1-11100f192ffc', '3d7c1116-85b6-4ef2-9923-4f4e6d8002a2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:32 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:32 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:33 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Deleted volume successfully. Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fb8b54e0-05cb-48aa-a568-c0ba9b6d1bb6 tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-e31c1392-2585-44c1-9c00-56179bf649aa-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7a899978-c094-4545-820f-40d94f5ba298 tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" by "attach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7a899978-c094-4545-820f-40d94f5ba298 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" acquired by "attach_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7a899978-c094-4545-820f-40d94f5ba298 tempest-VolumesActionsTest-2102197392 None] Attaching volume 622714b8-cd99-4d8f-85d8-2eeb41374570 to instance d518c8db-a195-405e-be86-56980d4bff37 at mountpoint /dev/vdb on host None. Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7a899978-c094-4545-820f-40d94f5ba298 tempest-VolumesActionsTest-2102197392 None] Attach volume completed successfully. Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7a899978-c094-4545-820f-40d94f5ba298 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570" released by "attach_volume" :: held 0.122s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-937542c0-42b1-49c4-a1c8-88680352a8eb tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" by "detach_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-937542c0-42b1-49c4-a1c8-88680352a8eb tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-937542c0-42b1-49c4-a1c8-88680352a8eb tempest-VolumesActionsTest-2102197392 None] Detaching volume 622714b8-cd99-4d8f-85d8-2eeb41374570 from instance d518c8db-a195-405e-be86-56980d4bff37. Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-937542c0-42b1-49c4-a1c8-88680352a8eb tempest-VolumesActionsTest-2102197392 None] Detach volume completed successfully. Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-937542c0-42b1-49c4-a1c8-88680352a8eb tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Flow 'volume_create_manager' (47f9368b-0466-495f-8a64-03f011cb11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9bab2-0c3a-4cba-a5fe-cbba3ba5f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b9bab2-0c3a-4cba-a5fe-cbba3ba5f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817251749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1f845c-d213-4a79-9128-2a6ba938785b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec4b0f844342a18294e1e86199a95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:34Z,use_quota=True,user_id='c3240ddffb2649338f9af5295b25e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce9453d-51d0-465a-b5cd-738116de3c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce9453d-51d0-465a-b5cd-738116de3c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca24c28-339f-4e95-97c3-1993eb2b71bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca24c28-339f-4e95-97c3-1993eb2b71bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1f845c-d213-4a79-9128-2a6ba938785b', 'volume_name': 'volume-db1f845c-d213-4a79-9128-2a6ba938785b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c950ae30-8bf6-45be-93e6-ccbdb962f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c950ae30-8bf6-45be-93e6-ccbdb962f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca50fba-57df-48cc-8ca4-d2868f6180db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:33 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Volume db1f845c-d213-4a79-9128-2a6ba938785b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1f845c-d213-4a79-9128-2a6ba938785b', 'volume_size': 1} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817251749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1f845c-d213-4a79-9128-2a6ba938785b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec4b0f844342a18294e1e86199a95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:34Z,use_quota=True,user_id='c3240ddffb2649338f9af5295b25e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Creating volume db1f845c-d213-4a79-9128-2a6ba938785b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:26:34 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:34 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b 1073741824 Jul 14 20:26:34 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:34 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b 1073741824" returned: 0 in 0.699s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:34 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b Jul 14 20:26:34 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:35 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca50fba-57df-48cc-8ca4-d2868f6180db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1f845c-d213-4a79-9128-2a6ba938785b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29332959-adab-444c-96f4-af1c17cc19b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:35 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Volume volume-db1f845c-d213-4a79-9128-2a6ba938785b (db1f845c-d213-4a79-9128-2a6ba938785b): created successfully Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29332959-adab-444c-96f4-af1c17cc19b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Flow 'volume_create_manager' (47f9368b-0466-495f-8a64-03f011cb11ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f7083ade-02a3-4ccf-8c12-3fedec3ef77d tempest-VolumesTransfersV355Test-1529068378 None] Created volume successfully. Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "cinder-db1f845c-d213-4a79-9128-2a6ba938785b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-db1f845c-d213-4a79-9128-2a6ba938785b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "cinder-quobyte-db1f845c-d213-4a79-9128-2a6ba938785b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-quobyte-db1f845c-d213-4a79-9128-2a6ba938785b" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6f4b3d-a462-4100-a91d-0f69b4c805cb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:36 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b Jul 14 20:26:36 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:36 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b" returned: 0 in 0.426s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:36 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b Jul 14 20:26:36 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:37 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-db1f845c-d213-4a79-9128-2a6ba938785b" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-quobyte-db1f845c-d213-4a79-9128-2a6ba938785b" released by "delete_volume" :: held 0.738s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Created reservations ['73f56303-f367-4cb3-a8ca-2992355db3fb', 'a3f27127-219f-40d6-8985-9792af1b57fe', 'f7bae74a-7bdf-4581-af7d-34d6d19ea815', 'd078cd71-efe4-4768-9f89-2b255218d8f9'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:37 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:37 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:37 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:37 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Deleted volume successfully. Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d076fa66-3525-43e2-98e9-fa833cf110a0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-60428037-1900-4e0e-88a7-c19b743ea50c tempest-VolumesTransfersV355Test-893532922 None] Lock "cinder-db1f845c-d213-4a79-9128-2a6ba938785b-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:37 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:26:37 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:38 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:38 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a70d2-8760-45ad-8e0d-6a7d13631b0f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:38 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:26:38 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:38 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.451s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.d202170c-b404-4ab5-ae9f-c62b02d6ac0e73bbl29b.img {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:38 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.d202170c-b404-4ab5-ae9f-c62b02d6ac0e73bbl29b.img Jul 14 20:26:38 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-a75c08f6-4dae-4df6-9ea1-7b87f96ca844 req-0a60c6fa-2e76-4dda-aa3d-9918c06e5305 tempest-TestMinimumBasicScenario-851218135 None] Terminate volume connection completed successfully. Jul 14 20:26:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-a75c08f6-4dae-4df6-9ea1-7b87f96ca844 req-0a60c6fa-2e76-4dda-aa3d-9918c06e5305 tempest-TestMinimumBasicScenario-851218135 None] Deleting attachment 7061ae1b-863d-4e78-b070-ec01f98efcef. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:26:44 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.d202170c-b404-4ab5-ae9f-c62b02d6ac0e73bbl29b.img" returned: 0 in 5.566s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90967d4-87b7-4e10-9996-b59079f2cbc5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:44 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:26:44 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "cinder-979bd08e-1fd6-405c-814a-46f2aac3f0f5-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:44 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.590s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.d202170c-b404-4ab5-ae9f-c62b02d6ac0e73bbl29b.img {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:26:44 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Converted 1024.00 MB image at 183.93 MB/s Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "cinder-979bd08e-1fd6-405c-814a-46f2aac3f0f5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] d202170c-b404-4ab5-ae9f-c62b02d6ac0e was raw, no need to convert to raw {{(pid=87600) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "cinder-quobyte-979bd08e-1fd6-405c-814a-46f2aac3f0f5" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:26:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "cinder-quobyte-979bd08e-1fd6-405c-814a-46f2aac3f0f5" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a2d40b-cc6d-4c05-b73e-b2b564d498fa]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:45 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 Jul 14 20:26:45 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:45 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5" returned: 0 in 0.402s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:45 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5 Jul 14 20:26:45 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:45 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-979bd08e-1fd6-405c-814a-46f2aac3f0f5" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "cinder-quobyte-979bd08e-1fd6-405c-814a-46f2aac3f0f5" released by "delete_volume" :: held 0.730s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Created reservations ['30b29af5-122b-4576-b56b-eb1c318e5e67', '3d7a74ad-e9c0-44a9-9a49-b15ba02d968d', 'dbf1c536-cdfa-4a51-992b-94367ebceb2d', '1dfb5dcc-564b-4508-ba04-483e63c1dc45'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:26:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:26:45 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:26:45 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:26:46 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 14 20:26:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:26:46 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:26:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Deleted volume successfully. Jul 14 20:26:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-536a19e7-e29b-4cb1-922a-5883e9bf1dfd tempest-TestMinimumBasicScenario-851218135 None] Lock "cinder-979bd08e-1fd6-405c-814a-46f2aac3f0f5-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Flow 'volume_create_manager' (49763f69-65b4-4471-b887-18e298703df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9129f99c-a397-4e85-be53-f1ae1e5ca5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9129f99c-a397-4e85-be53-f1ae1e5ca5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-798824425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e89df4-eac1-4a9e-94b7-55f6c5dccd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722688543634bf687159283306ebb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:48Z,use_quota=True,user_id='4ffc781d64364de88cf371c7486594a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d74a290-9102-4475-aaf3-d8e591c3f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d74a290-9102-4475-aaf3-d8e591c3f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9906e-9200-40e5-bcd2-64839f739e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9906e-9200-40e5-bcd2-64839f739e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e89df4-eac1-4a9e-94b7-55f6c5dccd0b', 'volume_name': 'volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b', 'volume_size': 2}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a146004-2c17-47d7-9e10-9a323f047db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a146004-2c17-47d7-9e10-9a323f047db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e273c24-6d87-4a54-b7a8-a24bedef28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:26:47 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Volume 09e89df4-eac1-4a9e-94b7-55f6c5dccd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b', 'volume_size': 2} Jul 14 20:26:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:03 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:03 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:03 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.345s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:27:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:27:04 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=34,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:27:04 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=3,cinder:SELECT=25 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.575s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Uploaded volume to glance image-id: d202170c-b404-4ab5-ae9f-c62b02d6ac0e. {{(pid=87600) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.350s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-798824425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e89df4-eac1-4a9e-94b7-55f6c5dccd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722688543634bf687159283306ebb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:26:48Z,use_quota=True,user_id='4ffc781d64364de88cf371c7486594a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Creating volume 09e89df4-eac1-4a9e-94b7-55f6c5dccd0b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:06 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b 2147483648 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:06 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b 2147483648 Jul 14 20:27:06 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0a3b9a0f-a8f5-4ed2-85dd-2b4c83b7c5ed tempest-VolumesActionsTest-2102197392 None] Copy volume to image completed successfully. Jul 14 20:27:06 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b 2147483648" returned: 0 in 0.480s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:06 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b Jul 14 20:27:06 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:07 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" returned: 0 in 0.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e273c24-6d87-4a54-b7a8-a24bedef28ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b', 'volume_size': 2}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0377f37-e427-4d14-a0ef-8f78197ffb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Volume volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b (09e89df4-eac1-4a9e-94b7-55f6c5dccd0b): created successfully Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0377f37-e427-4d14-a0ef-8f78197ffb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Flow 'volume_create_manager' (49763f69-65b4-4471-b887-18e298703df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-36755ce5-305e-4a9f-821d-7927cde1a943 tempest-VolumesCloneNegativeTest-874303121 None] Created volume successfully. Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[259247f4-cea7-45db-b77b-58986f5af405]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:08 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:27:08 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Acquiring lock "cinder-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:08 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.416s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "cinder-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7daad6-ef8b-4355-a31e-3c90da552460]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Acquiring lock "cinder-quobyte-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "cinder-quobyte-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccec555-c8f1-489f-bd1c-7ac51f0c2bd4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:08 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:27:08 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:08 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b Jul 14 20:27:08 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:09 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.436s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:09 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img Jul 14 20:27:09 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:09 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" returned: 0 in 0.411s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:09 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b Jul 14 20:27:09 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:09 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" returned: 0 in 0.363s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "cinder-quobyte-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b" released by "delete_volume" :: held 0.867s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Created reservations ['0c02b3bb-492c-449d-915f-b9d74620e16e', 'b250fba9-d99a-41d6-9e9f-ab5ca0ae8f05', '471b639d-d5d6-4614-9052-25ae998d3254', '09c5cdf8-0027-422f-80b8-cbe9d882c79a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:09 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:09 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:10 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.444s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Deleted volume successfully. Jul 14 20:27:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-52710f69-a4ba-4fdb-a469-a3cfd4a2ccf4 tempest-VolumesCloneNegativeTest-874303121 None] Lock "cinder-09e89df4-eac1-4a9e-94b7-55f6c5dccd0b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:14 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img" returned: 0 in 5.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3597e1d4-f776-42a0-ab9c-a982f9eb4a9a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:14 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:27:14 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:15 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.643s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:27:15 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Converted 1024.00 MB image at 194.16 MB/s Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] 139a8c33-a9ae-4b98-936d-f869ae136147 was raw, converting to qcow2 {{(pid=87600) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef20621-1d1f-498b-954c-3554f557ea2a]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:15 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img Jul 14 20:27:15 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:15 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img" returned: 0 in 0.423s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:15 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img Jul 14 20:27:15 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:15 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img" returned: 1 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:27:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img /opt/stack/data/cinder/conversion/vol_upload_h_tgtint {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:15 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img /opt/stack/data/cinder/conversion/vol_upload_h_tgtint Jul 14 20:27:15 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:16 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img /opt/stack/data/cinder/conversion/vol_upload_h_tgtint" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Image conversion details: src /opt/stack/data/cinder/conversion/622714b8-cd99-4d8f-85d8-2eeb41374570.temp_image.139a8c33-a9ae-4b98-936d-f869ae136147l1279zn9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h_tgtint {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:27:16 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[769174ba-5f02-4052-9307-4963fdcb9296]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h_tgtint {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:16 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h_tgtint Jul 14 20:27:16 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:16 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h_tgtint" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Flow 'volume_create_manager' (9c4f671b-e426-4660-a8df-f76d4413dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e10f6c4-2078-4095-a19c-7672bae2fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e10f6c4-2078-4095-a19c-7672bae2fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1343234707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a58e57-231e-4c96-8c1e-ce70d037e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca959ba470eb4b758458f989ccb6a3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:17Z,use_quota=True,user_id='d0a8f29654bd4bd594c4442d3b8681ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ac30f2-b413-4057-ab9e-e07d0bb386b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ac30f2-b413-4057-ab9e-e07d0bb386b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c84b209-34f0-4428-97e6-2266fc0b9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:16 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c84b209-34f0-4428-97e6-2266fc0b9be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7a58e57-231e-4c96-8c1e-ce70d037e1a7', 'volume_name': 'volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774a059c-899e-4c77-94a0-6c53a9fdf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774a059c-899e-4c77-94a0-6c53a9fdf185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b27a4e-ec28-4fef-a583-6492f56c4dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:17 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Trying to clone a7a58e57-231e-4c96-8c1e-ce70d037e1a7 from image a28aaf9a-7579-4123-bee1-aab6e137d44e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:27:17 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Image download 20.69 MB at 20.69 MB/s Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b34f2ba-6827-4143-bf7c-b04444086348]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:17 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD Jul 14 20:27:17 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:18 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e is fetched for user d0a8f29654bd4bd594c4442d3b8681ad. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.058s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Uploaded volume to glance image-id: 139a8c33-a9ae-4b98-936d-f869ae136147. {{(pid=87600) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 20:27:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ae24eb6c-f6c8-4fb8-b8cd-7c6a3a9446fd tempest-VolumesActionsTest-2102197392 None] Copy volume to image completed successfully. Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea043cd-a178-4158-ab0b-45c7756150ae]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:18 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD Jul 14 20:27:18 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:18 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1343234707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a58e57-231e-4c96-8c1e-ce70d037e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca959ba470eb4b758458f989ccb6a3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:17Z,use_quota=True,user_id='d0a8f29654bd4bd594c4442d3b8681ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Creating volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:18 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:18 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1073741824 Jul 14 20:27:18 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:19 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1073741824" returned: 0 in 0.488s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:19 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:19 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:19 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Attempting download of a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8c291-f76e-4b8e-b49a-5e33074e608e]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Acquiring lock "cinder-quobyte-622714b8-cd99-4d8f-85d8-2eeb41374570" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-quobyte-622714b8-cd99-4d8f-85d8-2eeb41374570" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:19 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt Jul 14 20:27:19 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4fb495-6350-4e8b-b7af-807548be6927]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:19 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:27:19 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:19 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt" returned: 0 in 0.351s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:19 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt Jul 14 20:27:19 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:20 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.498s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:20 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570 Jul 14 20:27:20 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:20 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt" returned: 1 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_9hehm4jt' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20727e-ccb5-46c7-90c0-06b711529369]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:20 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD Jul 14 20:27:20 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:20 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-622714b8-cd99-4d8f-85d8-2eeb41374570" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-quobyte-622714b8-cd99-4d8f-85d8-2eeb41374570" released by "delete_volume" :: held 0.815s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Created reservations ['30cb7c7e-acc8-4bb3-b0ee-962239e81695', 'cd27f55e-45c4-4f94-a048-317acdfa2d0b', '7b1024f3-1d4a-4225-9c2a-48a02d4d4ed3', 'ce09837a-c78b-4508-9054-cc5f20ebabba'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:20 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] a28aaf9a-7579-4123-bee1-aab6e137d44e was qcow2, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:20 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:20 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:20 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:20 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:20 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.289s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Deleted volume successfully. Jul 14 20:27:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e1d6747b-95c6-4401-9c57-6b6824378ce9 tempest-VolumesActionsTest-2102197392 None] Lock "cinder-622714b8-cd99-4d8f-85d8-2eeb41374570-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:22 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 1.879s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_5tsstyrmdevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:27:22 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Converted 112.00 MB image at 59.56 MB/s Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:22 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1G Jul 14 20:27:22 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:22 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 1G" returned: 0 in 0.337s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3779e7-2812-4c1f-b6ef-53efcd28c03d]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:22 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:22 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:23 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:23 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:23 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:23 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 1 in 0.419s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Downloaded image a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e for user d0a8f29654bd4bd594c4442d3b8681ad is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Marking volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Copying metadata from image a28aaf9a-7579-4123-bee1-aab6e137d44e to a7a58e57-231e-4c96-8c1e-ce70d037e1a7. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Creating volume glance metadata for volume a7a58e57-231e-4c96-8c1e-ce70d037e1a7 backed by image a28aaf9a-7579-4123-bee1-aab6e137d44e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b27a4e-ec28-4fef-a583-6492f56c4dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a63c366-d1b8-4ac1-9b91-ebfb080babba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Volume volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 (a7a58e57-231e-4c96-8c1e-ce70d037e1a7): created successfully Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a63c366-d1b8-4ac1-9b91-ebfb080babba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Flow 'volume_create_manager' (9c4f671b-e426-4660-a8df-f76d4413dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-437ccd1c-3ba4-43c0-ad91-bcac41f05168 tempest-VolumesExtendTest-924921734 None] Created volume successfully. Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2910c-5511-492b-a0d3-80d7e1b0dbc1]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:24 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:24 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:24 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:25 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:25 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:25 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 1 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 2G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 2G" returned: 0 in 0.073s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.967s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5913e4cc-2c53-441a-8b6e-b26546f5dc0a tempest-VolumesExtendTest-924921734 None] Extend volume completed successfully. Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-a7a58e57-231e-4c96-8c1e-ce70d037e1a7-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "cinder-a7a58e57-231e-4c96-8c1e-ce70d037e1a7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-quobyte-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71a639-6a2c-4870-b7b2-ea100d8a66ea]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:26 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:26 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:26 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 0.478s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:26 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:26 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:26 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 1 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:27:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:26 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7 Jul 14 20:27:26 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:27 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-a7a58e57-231e-4c96-8c1e-ce70d037e1a7" released by "delete_volume" :: held 1.201s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Created reservations ['308ddfe7-c755-4af7-972b-4bc2f5f7d949', 'e32123a6-ce34-4410-8f20-4f47eacc980a', 'bf66ca43-21d5-4b5a-aa3b-4e774941f6be', 'd481079c-2bdc-40c1-b6a1-262a3b6cbbd0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:27 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:27 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:27 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Deleted volume successfully. Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8f997106-e919-434d-b387-b8710154f3d1 tempest-VolumesExtendTest-924921734 None] Lock "cinder-a7a58e57-231e-4c96-8c1e-ce70d037e1a7-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Flow 'volume_create_manager' (c5c30118-488d-4698-b558-c5c586801d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2c9428-0853-4243-8a2a-a471fedd70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2c9428-0853-4243-8a2a-a471fedd70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-11238619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b08aa0-009a-4664-ac86-85f08379d161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597ca893c2e4da588751bde52537911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:28Z,use_quota=True,user_id='11607686fb4d4a1481e882275143f6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851ede75-a8e3-45c6-b8fc-fbb15a32a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851ede75-a8e3-45c6-b8fc-fbb15a32a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1a3d15-5549-4fd2-870a-5e055d2055b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1a3d15-5549-4fd2-870a-5e055d2055b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b08aa0-009a-4664-ac86-85f08379d161', 'volume_name': 'volume-95b08aa0-009a-4664-ac86-85f08379d161', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b842ea-397a-41f7-9134-1147973bee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b842ea-397a-41f7-9134-1147973bee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e084040-3e8a-4509-9993-d48031affd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Volume 95b08aa0-009a-4664-ac86-85f08379d161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b08aa0-009a-4664-ac86-85f08379d161', 'volume_size': 1} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-11238619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b08aa0-009a-4664-ac86-85f08379d161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597ca893c2e4da588751bde52537911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:28Z,use_quota=True,user_id='11607686fb4d4a1481e882275143f6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Creating volume 95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:27 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:27 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 1073741824 Jul 14 20:27:27 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:28 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 1073741824" returned: 0 in 0.555s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:28 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:28 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Flow 'volume_create_manager' (c3f3b8a5-6d61-46e4-a726-02dc300a450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea724d-6422-420e-936c-193f174d1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea724d-6422-420e-936c-193f174d1119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1253910210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bc44f7-2c3b-465b-a983-db6b20bd6ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca959ba470eb4b758458f989ccb6a3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:29Z,use_quota=True,user_id='d0a8f29654bd4bd594c4442d3b8681ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a139bec4-c053-4f50-8aaa-df53e03fafae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a139bec4-c053-4f50-8aaa-df53e03fafae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95183fa-4579-4ad2-b2da-aa4e240f0b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95183fa-4579-4ad2-b2da-aa4e240f0b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30bc44f7-2c3b-465b-a983-db6b20bd6ed8', 'volume_name': 'volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8d87-ab03-4d0a-84d0-9c6479830621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8d87-ab03-4d0a-84d0-9c6479830621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976a0843-244e-45e3-ae00-d53b4ddbd1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Volume 30bc44f7-2c3b-465b-a983-db6b20bd6ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8', 'volume_size': 1} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.354s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1253910210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bc44f7-2c3b-465b-a983-db6b20bd6ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca959ba470eb4b758458f989ccb6a3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:29Z,use_quota=True,user_id='d0a8f29654bd4bd594c4442d3b8681ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Creating volume 30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:28 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e084040-3e8a-4509-9993-d48031affd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b08aa0-009a-4664-ac86-85f08379d161', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 1073741824 Jul 14 20:27:28 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ef1126-e849-449b-b09d-b72e6a27c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:28 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Volume volume-95b08aa0-009a-4664-ac86-85f08379d161 (95b08aa0-009a-4664-ac86-85f08379d161): created successfully Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ef1126-e849-449b-b09d-b72e6a27c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Flow 'volume_create_manager' (c5c30118-488d-4698-b558-c5c586801d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7fe42e9b-461f-4cbb-bec5-7321ed46124a tempest-VolumesCloneTest-265460787 None] Created volume successfully. Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Flow 'volume_create_manager' (475d0455-3afc-440a-af4a-5927c94d663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44526d34-83ba-420f-8c27-934b95a3da06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44526d34-83ba-420f-8c27-934b95a3da06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1292152839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf49fe6-8315-4ad1-85b9-398e4b4cfa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3258156016334dfdabb95485b0fa050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:29Z,use_quota=True,user_id='3cad5b30378447e9bff75fc258639892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b44f67-670e-4857-b526-479e0c54ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b44f67-670e-4857-b526-479e0c54ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5549a7a2-e190-459a-a638-8c59c616c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5549a7a2-e190-459a-a638-8c59c616c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf49fe6-8315-4ad1-85b9-398e4b4cfa46', 'volume_name': 'volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fc5eff-6799-44b1-ad7a-84cae90a7a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fc5eff-6799-44b1-ad7a-84cae90a7a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48f140d-e383-4f6b-bb2e-edb125fbe8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Volume 4bf49fe6-8315-4ad1-85b9-398e4b4cfa46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46', 'volume_size': 1} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:29 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 1073741824" returned: 0 in 0.549s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:29 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:29 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:29 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.266s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1292152839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf49fe6-8315-4ad1-85b9-398e4b4cfa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3258156016334dfdabb95485b0fa050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:29Z,use_quota=True,user_id='3cad5b30378447e9bff75fc258639892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Creating volume 4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:29 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:29 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 1073741824 Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976a0843-244e-45e3-ae00-d53b4ddbd1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d662581-cc7e-4a30-9767-7afb738300f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Volume volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 (30bc44f7-2c3b-465b-a983-db6b20bd6ed8): created successfully Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d662581-cc7e-4a30-9767-7afb738300f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Flow 'volume_create_manager' (c3f3b8a5-6d61-46e4-a726-02dc300a450b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6dd13a59-d0ff-43d1-9d2b-d6ff909be9d3 tempest-VolumesExtendTest-924921734 None] Created volume successfully. Jul 14 20:27:30 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 1073741824" returned: 0 in 0.573s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:30 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:27:30 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Flow 'volume_create_manager' (9ea64326-a9a8-4872-b8ee-fa98d374aa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fdd915-2510-47e6-999d-c01a8f78b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fdd915-2510-47e6-999d-c01a8f78b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1605741119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acfae60-1a19-4129-9b09-344eeff60345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597ca893c2e4da588751bde52537911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=95b08aa0-009a-4664-ac86-85f08379d161,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:30Z,use_quota=True,user_id='11607686fb4d4a1481e882275143f6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce52e2fb-76d1-4336-9903-94a2901374a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce52e2fb-76d1-4336-9903-94a2901374a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832cc1f4-8351-4571-9767-b32c4bd6a052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832cc1f4-8351-4571-9767-b32c4bd6a052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0acfae60-1a19-4129-9b09-344eeff60345', 'volume_name': 'volume-0acfae60-1a19-4129-9b09-344eeff60345', 'volume_size': 2, 'source_volid': '95b08aa0-009a-4664-ac86-85f08379d161', 'source_volstatus': 'available'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e04cd2-1cac-4ca0-8bc5-976b56c2de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e04cd2-1cac-4ca0-8bc5-976b56c2de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a62c0c-5ce1-4b89-b4ff-55165c791708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Volume 0acfae60-1a19-4129-9b09-344eeff60345: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0acfae60-1a19-4129-9b09-344eeff60345', 'volume_size': 2, 'source_volid': '95b08aa0-009a-4664-ac86-85f08379d161', 'source_volstatus': 'available'} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.295s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:30 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Cloning volume 95b08aa0-009a-4664-ac86-85f08379d161 to volume 0acfae60-1a19-4129-9b09-344eeff60345 Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48f140d-e383-4f6b-bb2e-edb125fbe8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d3c96-10d6-4bda-8e73-cdc43c970361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Volume volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 (4bf49fe6-8315-4ad1-85b9-398e4b4cfa46): created successfully Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d3c96-10d6-4bda-8e73-cdc43c970361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Flow 'volume_create_manager' (475d0455-3afc-440a-af4a-5927c94d663e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9fee188f-9333-4089-b32b-176ef749d667 tempest-TestStampPattern-1766617191 None] Created volume successfully. Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Creating offline snapshot 13b74283-a8f0-47a3-ba86-7ce1d9488d0b of volume 95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54dab44-72e2-4657-bc85-5e15d2cdb690]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:30 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:30 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:31 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:31 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b 1G Jul 14 20:27:31 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:31 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b 1G" returned: 0 in 0.531s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b08aa0-009a-4664-ac86-85f08379d161 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:31 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b08aa0-009a-4664-ac86-85f08379d161 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:31 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:31 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95b08aa0-009a-4664-ac86-85f08379d161 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.314s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:31 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b is being set with open permissions: ugo+rw Jul 14 20:27:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:32 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:32 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:32 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.303s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:32 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info Jul 14 20:27:32 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:32 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info" returned: 0 in 0.281s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:32 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info is being set with open permissions: ugo+rw Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:32 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info Jul 14 20:27:32 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:32 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.info" returned: 0 in 0.240s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] snapshot: 13b74283-a8f0-47a3-ba86-7ce1d9488d0b, volume: 0acfae60-1a19-4129-9b09-344eeff60345, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[113453a5-22f9-4140-ac18-c1a74f45b2b3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:33 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:33 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:33 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b08aa0-009a-4664-ac86-85f08379d161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52eddc-02a1-48b3-9dd0-8cec2640f0b1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:33 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:33 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:33 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:27:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:33 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 Jul 14 20:27:33 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:40 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345" returned: 0 in 6.663s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba704a36-f7d7-47bf-b2b8-a69471ec1bf4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:40 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:40 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:40 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.540s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:27:40 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Converted 1024.00 MB image at 153.67 MB/s Jul 14 20:27:40 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 is being set with open permissions: ugo+rw Jul 14 20:27:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:40 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 Jul 14 20:27:40 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:41 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345" returned: 0 in 0.292s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" released by "_copy_volume_from_snapshot" :: held 8.356s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-quobyte-13b74283-a8f0-47a3-ba86-7ce1d9488d0b" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-13b74283-a8f0-47a3-ba86-7ce1d9488d0b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Deleting offline snapshot 13b74283-a8f0-47a3-ba86-7ce1d9488d0b of volume 95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] snapshot_file for this snap is: volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e5d9d-265c-4720-8cdc-7acdca09703e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:41 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:41 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:41 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95b08aa0-009a-4664-ac86-85f08379d161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a67f91b-91f3-4927-9f61-93ba00924b05]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:41 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:41 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:42 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.396s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:42 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:42 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=50,cinder:SELECT=42,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:27:42 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:42 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b Jul 14 20:27:42 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:42 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161.13b74283-a8f0-47a3-ba86-7ce1d9488d0b" returned: 0 in 0.291s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-13b74283-a8f0-47a3-ba86-7ce1d9488d0b" released by "_delete_snapshot" :: held 1.575s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.242s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.845s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Creating offline snapshot 9569809a-0a31-436c-8c0f-b960c0c39711 of volume 30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a62c0c-5ce1-4b89-b4ff-55165c791708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0acfae60-1a19-4129-9b09-344eeff60345', 'volume_size': 2, 'source_volid': '95b08aa0-009a-4664-ac86-85f08379d161', 'source_volstatus': 'available'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7316ebf-2292-41a5-939f-0fb7f2587161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17fc6df-eaeb-4445-a0e8-80ed1882b429]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:42 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Volume volume-0acfae60-1a19-4129-9b09-344eeff60345 (0acfae60-1a19-4129-9b09-344eeff60345): created successfully Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7316ebf-2292-41a5-939f-0fb7f2587161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Flow 'volume_create_manager' (9ea64326-a9a8-4872-b8ee-fa98d374aa17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6f432561-1f32-40c5-a2b9-49b614f1d638 tempest-VolumesCloneTest-265460787 None] Created volume successfully. Jul 14 20:27:43 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:43 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:43 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:43 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 1G Jul 14 20:27:43 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:43 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 1G" returned: 0 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:43 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 Jul 14 20:27:43 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-0acfae60-1a19-4129-9b09-344eeff60345-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "cinder-0acfae60-1a19-4129-9b09-344eeff60345-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:44 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 is being set with open permissions: ugo+rw Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd9937-2428-47cb-98ff-f8375015e911]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 Jul 14 20:27:44 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 Jul 14 20:27:44 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info Jul 14 20:27:44 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345 Jul 14 20:27:44 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info is being set with open permissions: ugo+rw Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info Jul 14 20:27:44 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0acfae60-1a19-4129-9b09-344eeff60345" returned: 0 in 0.261s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-0acfae60-1a19-4129-9b09-344eeff60345" released by "delete_volume" :: held 0.692s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Created reservations ['41ebf976-2d08-4387-a4b1-133cd66e8507', '30a2bf9a-b5bd-404f-bf62-b56d8a4b83b5', '152d7e91-6f95-44c1-a7a3-ea407faff610', '30c72f78-127f-4999-b089-b76c5ea1ff87'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:44 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.info" returned: 0 in 0.283s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:44 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:44 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fc949bba-eda5-41f4-a5f8-06bc498dca6d tempest-VolumesExtendTest-924921734 None] Create snapshot completed successfully Jul 14 20:27:45 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Deleted volume successfully. Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c671b88b-7aa6-4299-bf2d-ed1a073d1099 tempest-VolumesCloneTest-265460787 None] Lock "cinder-0acfae60-1a19-4129-9b09-344eeff60345-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-95b08aa0-009a-4664-ac86-85f08379d161-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "cinder-95b08aa0-009a-4664-ac86-85f08379d161-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Acquiring lock "cinder-quobyte-95b08aa0-009a-4664-ac86-85f08379d161" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-95b08aa0-009a-4664-ac86-85f08379d161" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b8516-757a-4470-830e-a54a89442582]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:45 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:45 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:45 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:45 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161 Jul 14 20:27:45 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:45 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-95b08aa0-009a-4664-ac86-85f08379d161" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "cinder-quobyte-95b08aa0-009a-4664-ac86-85f08379d161" released by "delete_volume" :: held 0.668s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Created reservations ['124c4024-c390-42d8-b9ff-4bec9288bab7', '0165260a-b17a-40c7-b5f2-ba4cfdf9dac5', '687827f2-25aa-4d05-baac-5ecebe29e3a8', '68b5d7ea-ae25-4554-b111-623f241a8bdc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adcbf21-9a33-43ad-bd6b-4ae69ed94dbb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:46 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:46 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:46 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:46 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:46 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Deleted volume successfully. Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c12d596e-b1c6-4826-9303-e2aa6be0b659 tempest-VolumesCloneTest-265460787 None] Lock "cinder-95b08aa0-009a-4664-ac86-85f08379d161-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:46 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 2G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 2G" returned: 0 in 0.161s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.634s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cbfbdfd7-9c34-4176-a286-914133c0fb8e tempest-VolumesExtendTest-924921734 None] Extend volume completed successfully. Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-9569809a-0a31-436c-8c0f-b960c0c39711-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-9569809a-0a31-436c-8c0f-b960c0c39711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-quobyte-9569809a-0a31-436c-8c0f-b960c0c39711" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-9569809a-0a31-436c-8c0f-b960c0c39711" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Deleting offline snapshot 9569809a-0a31-436c-8c0f-b960c0c39711 of volume 30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] snapshot_file for this snap is: volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dc6db1-626d-4b29-aced-4e8b825c8f0a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:47 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 Jul 14 20:27:47 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:47 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711" returned: 0 in 0.462s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa95575-070d-49ea-85e2-c60ae90ff315]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:48 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:48 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:48 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.423s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:48 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 Jul 14 20:27:48 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:48 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:48 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711 Jul 14 20:27:48 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:49 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8.9569809a-0a31-436c-8c0f-b960c0c39711" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-9569809a-0a31-436c-8c0f-b960c0c39711" released by "_delete_snapshot" :: held 1.690s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" released by "delete_snapshot" :: held 1.723s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Created reservations ['9aa7e7fa-1725-4ac1-91b4-300aca21bb61', '5acf9544-95a7-44b6-9945-f617c94f7fc8', 'a0bcbab0-6cc3-4c2a-84fa-78290525ba2c', 'e0ee0ad2-be2a-4b58-8e18-295201027e92'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Delete snapshot completed successfully. Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ad608b0-74b1-47cb-b5e1-22856fb351ce tempest-VolumesExtendTest-924921734 None] Lock "cinder-9569809a-0a31-436c-8c0f-b960c0c39711-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-30bc44f7-2c3b-465b-a983-db6b20bd6ed8-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "cinder-30bc44f7-2c3b-465b-a983-db6b20bd6ed8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (f3d14631-8441-4c0b-a6be-945b199fae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6253ec28-5119-4213-a7d7-69a1265c2429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6253ec28-5119-4213-a7d7-69a1265c2429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601736980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d095a73-8f59-4a8a-85b6-77033e8c4a3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:50Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93387c26-fdb0-4124-a1b5-c42ba729337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93387c26-fdb0-4124-a1b5-c42ba729337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b10726-147c-42fd-9099-b7d0849cecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b10726-147c-42fd-9099-b7d0849cecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d095a73-8f59-4a8a-85b6-77033e8c4a3e', 'volume_name': 'volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e56fe-fc9b-40b9-b995-1668c65ad1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e56fe-fc9b-40b9-b995-1668c65ad1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afe0cb6-f2bc-4b6a-a249-471a0624dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Volume 7d095a73-8f59-4a8a-85b6-77033e8c4a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e', 'volume_size': 1} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601736980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d095a73-8f59-4a8a-85b6-77033e8c4a3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:50Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Creating volume 7d095a73-8f59-4a8a-85b6-77033e8c4a3e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:49 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e 1073741824 Jul 14 20:27:49 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Acquiring lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d73329c-dd5c-4480-ba19-81f434db3fae]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:49 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:49 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:50 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e 1073741824" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:50 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.385s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:50 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8 Jul 14 20:27:50 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:50 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e Jul 14 20:27:50 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:50 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:50 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afe0cb6-f2bc-4b6a-a249-471a0624dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2a9101-4610-4467-8e2a-55cdbeec57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "cinder-quobyte-30bc44f7-2c3b-465b-a983-db6b20bd6ed8" released by "delete_volume" :: held 0.735s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Volume volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e (7d095a73-8f59-4a8a-85b6-77033e8c4a3e): created successfully Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2a9101-4610-4467-8e2a-55cdbeec57f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (f3d14631-8441-4c0b-a6be-945b199fae14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-25f30249-6e5a-4435-9e8b-5c557dcf7f32 tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Created reservations ['ff8656df-fb23-4048-9bc4-f323bb193c4f', '5a0c87a4-79a7-4016-b93a-9f326ae0f119', '75371156-fd5b-4cbd-ae73-c9d5e1c973de', '1f8192c7-41c6-4af5-a8db-5f3a6848e162'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:50 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:50 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:50 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Deleted volume successfully. Jul 14 20:27:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0769bab5-e453-441d-afe6-a4908a73539b tempest-VolumesExtendTest-924921734 None] Lock "cinder-30bc44f7-2c3b-465b-a983-db6b20bd6ed8-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (f0b53f9e-1037-4848-aee8-22ccce7c8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdef9db0-98ef-4497-96cc-0e9852bd8202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdef9db0-98ef-4497-96cc-0e9852bd8202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1550034371',display_name='tempest-VolumesGetTest-Volume-562459779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e6a6a8-fa60-4b9f-a152-3cc76792aebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:52Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5db1cc-8200-4b2f-9f1b-7b12f9ee0398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5db1cc-8200-4b2f-9f1b-7b12f9ee0398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dd7c4-fa05-4a63-94af-45f050140d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dd7c4-fa05-4a63-94af-45f050140d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e6a6a8-fa60-4b9f-a152-3cc76792aebf', 'volume_name': 'volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c74763-d49b-41d5-a6e6-1614ed00783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c74763-d49b-41d5-a6e6-1614ed00783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566fdeb-bcfe-4852-b52b-777eedcef036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Volume 71e6a6a8-fa60-4b9f-a152-3cc76792aebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf', 'volume_size': 1} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1550034371',display_name='tempest-VolumesGetTest-Volume-562459779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e6a6a8-fa60-4b9f-a152-3cc76792aebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:52Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Creating volume 71e6a6a8-fa60-4b9f-a152-3cc76792aebf {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:52 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:52 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf 1073741824 Jul 14 20:27:52 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:52 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf 1073741824" returned: 0 in 0.481s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:53 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf Jul 14 20:27:53 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:53 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" returned: 0 in 0.266s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566fdeb-bcfe-4852-b52b-777eedcef036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9710cf7b-fa37-42ef-a95d-f4a8c7d4d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Volume volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf (71e6a6a8-fa60-4b9f-a152-3cc76792aebf): created successfully Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9710cf7b-fa37-42ef-a95d-f4a8c7d4d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (f0b53f9e-1037-4848-aee8-22ccce7c8166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-84d22f37-e9b4-4161-a755-aa0cd6bd7a3a tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (1eb91fe0-03b9-43b0-b610-89ef694ffebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a032596c-d17c-48cf-b1db-29e5874042f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a032596c-d17c-48cf-b1db-29e5874042f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193396162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18252c8a-dee8-4828-b252-0822750cc724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:54Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2d7bd1-9ae8-4522-a860-d6853cf618de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2d7bd1-9ae8-4522-a860-d6853cf618de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786a980c-e6a4-4d36-b8af-318f6e7fdbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786a980c-e6a4-4d36-b8af-318f6e7fdbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18252c8a-dee8-4828-b252-0822750cc724', 'volume_name': 'volume-18252c8a-dee8-4828-b252-0822750cc724', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144990f7-4acd-48c5-90fd-82e589b99370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144990f7-4acd-48c5-90fd-82e589b99370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e13728-1cae-47c5-80c7-17931aa37de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume 18252c8a-dee8-4828-b252-0822750cc724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18252c8a-dee8-4828-b252-0822750cc724', 'volume_size': 1} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193396162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18252c8a-dee8-4828-b252-0822750cc724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:54Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume 18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:53 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:53 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 1073741824 Jul 14 20:27:53 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:54 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 1073741824" returned: 0 in 0.436s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:54 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 Jul 14 20:27:54 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:54 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724" returned: 0 in 0.266s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e13728-1cae-47c5-80c7-17931aa37de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18252c8a-dee8-4828-b252-0822750cc724', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140f6ee0-76a8-490d-a0f4-f0bb52d1aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-18252c8a-dee8-4828-b252-0822750cc724 (18252c8a-dee8-4828-b252-0822750cc724): created successfully Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140f6ee0-76a8-490d-a0f4-f0bb52d1aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (1eb91fe0-03b9-43b0-b610-89ef694ffebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cffcf57a-3405-4e2b-892b-9332d91c3154 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-71e6a6a8-fa60-4b9f-a152-3cc76792aebf-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "cinder-71e6a6a8-fa60-4b9f-a152-3cc76792aebf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[797972fe-b9e1-4c0e-9a2b-f455d24fb2aa]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:54 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf Jul 14 20:27:54 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating offline snapshot b7bb2bfc-89ac-4912-9903-8a7f43351cec of volume 18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b4f0f-9b6b-490b-9b73-4df3921d6790]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:55 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 Jul 14 20:27:55 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:55 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:55 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf Jul 14 20:27:55 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:55 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:55 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec 1G Jul 14 20:27:55 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:55 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-71e6a6a8-fa60-4b9f-a152-3cc76792aebf" released by "delete_volume" :: held 0.664s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Created reservations ['9af9e559-908f-4e8e-9baa-bfcd2744bb9f', '27da8151-aa5a-44b4-aa75-a0d059625c22', '50a768f7-47ea-4cb7-b76f-6c79bc9effb4', '64fcf9b7-f33b-4c3c-b004-5a83c9f90c9f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:55 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:55 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:55 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec 1G" returned: 0 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18252c8a-dee8-4828-b252-0822750cc724 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:55 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18252c8a-dee8-4828-b252-0822750cc724 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec Jul 14 20:27:55 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:55 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.329s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:27:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-14c9ef23-d387-4931-8d47-263d275a83af tempest-VolumesGetTest-1891638670 None] Lock "cinder-71e6a6a8-fa60-4b9f-a152-3cc76792aebf-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-7d095a73-8f59-4a8a-85b6-77033e8c4a3e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "cinder-7d095a73-8f59-4a8a-85b6-77033e8c4a3e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0d67a-3e86-45ba-bae6-80db1bc808d0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:56 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18252c8a-dee8-4828-b252-0822750cc724 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec" returned: 0 in 0.517s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:56 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec is being set with open permissions: ugo+rw Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:56 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec Jul 14 20:27:56 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:56 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e Jul 14 20:27:56 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:56 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:56 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:56 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info Jul 14 20:27:56 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:56 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e Jul 14 20:27:56 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:56 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info" returned: 0 in 0.250s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:56 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info is being set with open permissions: ugo+rw Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:56 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info Jul 14 20:27:56 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:56 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-7d095a73-8f59-4a8a-85b6-77033e8c4a3e" released by "delete_volume" :: held 0.716s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:56 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Created reservations ['16d15840-82e8-478a-ba49-4bc6b2c04941', 'd2a6c787-9d14-4d57-96db-6043ab66d22a', '09012bc0-0106-4ab4-b48c-665af3245153', '4d675dd7-0705-4ee5-ba71-00763e36fcdb'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:57 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:27:57 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:57 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.info" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b35f287f-dc63-402b-b805-e304fef7092c tempest-CreateVolumesFromSnapshotTest-2094252788 None] Create snapshot completed successfully Jul 14 20:27:57 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:27:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f3cd5f84-8720-433a-a93a-aae60ba30cf3 tempest-VolumesGetTest-1891638670 None] Lock "cinder-7d095a73-8f59-4a8a-85b6-77033e8c4a3e-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (447c324f-45ac-4156-8b9f-ab79a8bfcf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89afddd8-b319-40c3-9286-0d2aaee72f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89afddd8-b319-40c3-9286-0d2aaee72f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-330067488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:58Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b21137-cffe-4332-81a0-811c267d4b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b21137-cffe-4332-81a0-811c267d4b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9e6aef-85dc-4d5a-9324-b81370e3c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9e6aef-85dc-4d5a-9324-b81370e3c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'volume_name': 'volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b31bac-763c-400f-8d64-de12278f4a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b31bac-763c-400f-8d64-de12278f4a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4e06a-e3fe-4ea8-9f19-b428f087d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:57 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Volume 8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'volume_size': 1} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-330067488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:58Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Creating volume 8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:57 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:57 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 1073741824 Jul 14 20:27:57 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:58 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 1073741824" returned: 0 in 0.426s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:58 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:27:58 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:58 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (5b406527-aed2-4f55-8758-8cf0a1c0c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defbcef7-9480-4965-8036-35b06df4c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defbcef7-9480-4965-8036-35b06df4c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898778825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ae912c-cc7c-4024-ad39-107da6243b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ae912c-cc7c-4024-ad39-107da6243b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272bb58-690a-4715-a3b8-7ac1f83edb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272bb58-690a-4715-a3b8-7ac1f83edb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c', 'volume_name': 'volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2a5621-6105-4bf6-a1e5-1dca5ca533f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2a5621-6105-4bf6-a1e5-1dca5ca533f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fe456-776c-4a38-a0a9-b4543159d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume 8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c', 'volume_size': 1} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898778825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume 8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:58 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4e06a-e3fe-4ea8-9f19-b428f087d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10842386-b985-4ea1-a8a2-0048b0e0abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c 1073741824 Jul 14 20:27:58 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Volume volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 (8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5): created successfully Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10842386-b985-4ea1-a8a2-0048b0e0abc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (447c324f-45ac-4156-8b9f-ab79a8bfcf96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e40ccb7c-035d-4527-bfba-8e5a34b022bd tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (a4dfef8c-c8f9-4de9-82ee-cdc361d920c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583ad652-0954-4d55-a288-54bbcbb44c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583ad652-0954-4d55-a288-54bbcbb44c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5034290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a50111-4e2b-4385-b7ed-0b5f1152ed59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9001543c-4d9d-49c5-a833-f8899875d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9001543c-4d9d-49c5-a833-f8899875d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a7be5d-7c9b-40e0-b146-86d000aa867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a7be5d-7c9b-40e0-b146-86d000aa867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a50111-4e2b-4385-b7ed-0b5f1152ed59', 'volume_name': 'volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847ff3b-83eb-43f6-8217-f2d124e21954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847ff3b-83eb-43f6-8217-f2d124e21954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda99e6d-11d8-4590-a3c9-aff2b933cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume e8a50111-4e2b-4385-b7ed-0b5f1152ed59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59', 'volume_size': 1} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:59 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c 1073741824" returned: 0 in 0.551s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:59 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c Jul 14 20:27:59 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (7ec89ce5-48f6-4687-954e-28a0cfaa2a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a694b4bc-086b-48e0-b695-6871ec221df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a694b4bc-086b-48e0-b695-6871ec221df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159718541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e0c1f7-2f9d-4f48-a9e8-a12adecad29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7fa0e6-7bc3-49e6-a21e-b12a50a8a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7fa0e6-7bc3-49e6-a21e-b12a50a8a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588f2c17-3818-4c88-a2dc-33ff82144082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588f2c17-3818-4c88-a2dc-33ff82144082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e0c1f7-2f9d-4f48-a9e8-a12adecad29c', 'volume_name': 'volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8629497a-2585-4243-9edd-6542af2700e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8629497a-2585-4243-9edd-6542af2700e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69720cb3-7c6c-4242-bcdf-17b0358f543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume 72e0c1f7-2f9d-4f48-a9e8-a12adecad29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c', 'volume_size': 1} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:59 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" returned: 0 in 0.298s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5034290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a50111-4e2b-4385-b7ed-0b5f1152ed59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume e8a50111-4e2b-4385-b7ed-0b5f1152ed59 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:27:59 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 1073741824 Jul 14 20:27:59 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fe456-776c-4a38-a0a9-b4543159d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec9ab8-8198-4ff9-bb0f-a9e87b184fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c (8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c): created successfully Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec9ab8-8198-4ff9-bb0f-a9e87b184fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (5b406527-aed2-4f55-8758-8cf0a1c0c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d93b6b6f-ad9c-4f84-971a-1a7d2718ba16 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (31ea4131-bdea-44c3-b83d-9dbe78ed3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960baf21-9b39-4130-85de-08f7335707d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960baf21-9b39-4130-85de-08f7335707d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724584545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb82c64-e743-43c1-88e6-3e5561fdddf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:00Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f08b00d-c687-4232-aefa-43e1080aefeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f08b00d-c687-4232-aefa-43e1080aefeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7d8611-8296-49c8-af89-175966a4fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7d8611-8296-49c8-af89-175966a4fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb82c64-e743-43c1-88e6-3e5561fdddf3', 'volume_name': 'volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3277c38-6d50-4140-aa39-decb7f31d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3277c38-6d50-4140-aa39-decb7f31d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc52627-10a4-436b-a4a2-7a480cbd2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:27:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume 8eb82c64-e743-43c1-88e6-3e5561fdddf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3', 'volume_size': 1} Jul 14 20:27:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (f0219deb-dc1a-4892-887b-09e55fc1eb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3b6952-8691-4605-820e-03a0be33f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3b6952-8691-4605-820e-03a0be33f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212696371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3101a6f8-4b4c-47cb-a273-d62942292b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:00Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5f708d-28a2-44bd-b85e-f247b00ad67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5f708d-28a2-44bd-b85e-f247b00ad67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7810c3a3-d63c-4f69-bd6a-0596d740de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7810c3a3-d63c-4f69-bd6a-0596d740de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3101a6f8-4b4c-47cb-a273-d62942292b04', 'volume_name': 'volume-3101a6f8-4b4c-47cb-a273-d62942292b04', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf11ca5-9372-444d-a8a5-a0f2e6b79359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf11ca5-9372-444d-a8a5-a0f2e6b79359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c33e66-148c-4d88-8331-0cef0d3a743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume 3101a6f8-4b4c-47cb-a273-d62942292b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3101a6f8-4b4c-47cb-a273-d62942292b04', 'volume_size': 1} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 1073741824" returned: 0 in 0.723s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:00 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 Jul 14 20:28:00 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (b6f61f29-8465-4043-9b22-7a3b4b7b5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3091b68d-db5d-4980-856d-9daba4dd474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3091b68d-db5d-4980-856d-9daba4dd474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1843253436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f459501b-08b2-45bb-8629-232a83d08302,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:00Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59740871-7c7b-4050-9c10-71f9b89a25a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59740871-7c7b-4050-9c10-71f9b89a25a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e2fd2-96db-4c28-bdbc-df8dd1553655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e2fd2-96db-4c28-bdbc-df8dd1553655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f459501b-08b2-45bb-8629-232a83d08302', 'volume_name': 'volume-f459501b-08b2-45bb-8629-232a83d08302', 'volume_size': 1, 'source_volid': '8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'source_volstatus': 'available'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec46548-5729-4ffa-b2d2-3c1208adddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec46548-5729-4ffa-b2d2-3c1208adddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e638b8c-7b95-464d-8497-394ba22bc862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Volume f459501b-08b2-45bb-8629-232a83d08302: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f459501b-08b2-45bb-8629-232a83d08302', 'volume_size': 1, 'source_volid': '8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'source_volstatus': 'available'} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.205s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159718541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e0c1f7-2f9d-4f48-a9e8-a12adecad29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:27:59Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume 72e0c1f7-2f9d-4f48-a9e8-a12adecad29c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:00 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:00 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c 1073741824 Jul 14 20:28:00 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda99e6d-11d8-4590-a3c9-aff2b933cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0029b4cc-bdf3-443e-a268-43b33229f825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 (e8a50111-4e2b-4385-b7ed-0b5f1152ed59): created successfully Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0029b4cc-bdf3-443e-a268-43b33229f825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (a4dfef8c-c8f9-4de9-82ee-cdc361d920c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-84bfb8f2-92ed-4cd4-afa0-b5810589f155 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:28:01 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c 1073741824" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:01 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c Jul 14 20:28:01 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:01 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" returned: 0 in 0.249s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724584545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb82c64-e743-43c1-88e6-3e5561fdddf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:00Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume 8eb82c64-e743-43c1-88e6-3e5561fdddf3 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:01 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69720cb3-7c6c-4242-bcdf-17b0358f543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:01 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 1073741824 Jul 14 20:28:01 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7977df9c-de8a-459d-b45d-c2556f1f5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c (72e0c1f7-2f9d-4f48-a9e8-a12adecad29c): created successfully Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7977df9c-de8a-459d-b45d-c2556f1f5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (7ec89ce5-48f6-4687-954e-28a0cfaa2a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-41e0975f-3f1f-4362-8544-919c17e45328 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:28:01 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 1073741824" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:01 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 Jul 14 20:28:01 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:02 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212696371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3101a6f8-4b4c-47cb-a273-d62942292b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d4170418d4c1c88e0cc2509e1d1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:00Z,use_quota=True,user_id='b9b2c7c0876742b8bc1b7fdfd8c1d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Creating volume 3101a6f8-4b4c-47cb-a273-d62942292b04 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:02 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc52627-10a4-436b-a4a2-7a480cbd2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65fda53-2737-4e64-82fe-d8dab4999695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:02 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 1073741824 Jul 14 20:28:02 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 (8eb82c64-e743-43c1-88e6-3e5561fdddf3): created successfully Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65fda53-2737-4e64-82fe-d8dab4999695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (31ea4131-bdea-44c3-b83d-9dbe78ed3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d943a46e-0988-415b-860b-31caa2e266df tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:02 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 1073741824" returned: 0 in 0.573s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:02 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 Jul 14 20:28:02 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:03 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.429s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Cloning volume 8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 to volume f459501b-08b2-45bb-8629-232a83d08302 Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c33e66-148c-4d88-8331-0cef0d3a743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3101a6f8-4b4c-47cb-a273-d62942292b04', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329942dc-969f-425d-a3a0-472a689cce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Volume volume-3101a6f8-4b4c-47cb-a273-d62942292b04 (3101a6f8-4b4c-47cb-a273-d62942292b04): created successfully Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329942dc-969f-425d-a3a0-472a689cce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Flow 'volume_create_manager' (f0219deb-dc1a-4892-887b-09e55fc1eb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Creating offline snapshot 8248d7da-11dd-45ad-aa15-4ecec1fdbf62 of volume 8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-72ab92f4-13ae-4cbd-b920-448d44ceddb1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created volume successfully. Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d443f7a-0518-4c43-be9c-7767d1606fa4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:03 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:03 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:28:03 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:03 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 1G Jul 14 20:28:03 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-3101a6f8-4b4c-47cb-a273-d62942292b04-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-3101a6f8-4b4c-47cb-a273-d62942292b04-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-3101a6f8-4b4c-47cb-a273-d62942292b04" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-3101a6f8-4b4c-47cb-a273-d62942292b04" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f48e5-4221-45d9-aabe-db58c8f0a42f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:03 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 Jul 14 20:28:03 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:03 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 1G" returned: 0 in 0.424s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:03 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:03 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04" returned: 0 in 0.371s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:04 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04 Jul 14 20:28:04 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 is being set with open permissions: ugo+rw Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:04 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:04 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3101a6f8-4b4c-47cb-a273-d62942292b04" returned: 0 in 0.240s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-3101a6f8-4b4c-47cb-a273-d62942292b04" released by "delete_volume" :: held 0.654s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=102,cinder:INSERT=39,cinder:UPDATE=110,cinder:DELETE=15 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['de0ab429-d132-4612-9aae-df40e53d0744', '693ed061-3ed2-45ee-9422-5688b7ae5bac', '2445fbbd-db59-4b11-aa02-48b3cf49821e', '0663aaac-0b27-4563-a2d5-fc0390e9fb77'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:04 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:04 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info Jul 14 20:28:04 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:04 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:04 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info" returned: 0 in 0.272s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info is being set with open permissions: ugo+rw Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:04 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:04 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info Jul 14 20:28:04 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d43ba8bd-7bef-4b52-b9a5-4cbc2e2f2161 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-3101a6f8-4b4c-47cb-a273-d62942292b04-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-8eb82c64-e743-43c1-88e6-3e5561fdddf3-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-8eb82c64-e743-43c1-88e6-3e5561fdddf3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-8eb82c64-e743-43c1-88e6-3e5561fdddf3" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-8eb82c64-e743-43c1-88e6-3e5561fdddf3" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[899c91c9-5009-44eb-a88a-eba74484985f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.info" returned: 0 in 0.261s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] snapshot: 8248d7da-11dd-45ad-aa15-4ecec1fdbf62, volume: f459501b-08b2-45bb-8629-232a83d08302, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:05 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 Jul 14 20:28:05 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a99770-5c04-4098-9aa5-deecee17292f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:05 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3" returned: 0 in 0.360s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3 Jul 14 20:28:05 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c5b77-2bca-4e0f-b6e2-b94221b09bf9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:05 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8eb82c64-e743-43c1-88e6-3e5561fdddf3" returned: 0 in 0.252s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-8eb82c64-e743-43c1-88e6-3e5561fdddf3" released by "delete_volume" :: held 0.655s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['6c7decd6-64ea-4a14-a6f2-db3a36fe3166', '6f8f7a11-7a30-4124-ace4-e0b58484d65c', 'e480bdde-5e79-4b35-8118-603667b7f82d', 'e79a7661-4a80-415c-8d8d-28b4b73eba5f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:05 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:05 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 Jul 14 20:28:05 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:05 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:05 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36fd27e0-55f7-406c-8e5a-38ca50a3f0f1 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-8eb82c64-e743-43c1-88e6-3e5561fdddf3-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2072239a-7ff1-4e91-8e9a-050de96f1084]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:06 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c Jul 14 20:28:06 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:06 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" returned: 0 in 0.513s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:06 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c Jul 14 20:28:06 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:07 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" returned: 0 in 0.506s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c" released by "delete_volume" :: held 1.082s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['94a5c850-291f-4204-8477-76ac458e42f9', '8308208d-43dc-4bf8-8531-4cfd0a891483', 'c5554556-dae4-4b81-828d-2de1734cab31', '21bc1126-3153-4a8e-91c8-0b46d574be46'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:07 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:07 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:07 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c867e204-62ba-4894-95c0-473a90ee56e4 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-72e0c1f7-2f9d-4f48-a9e8-a12adecad29c-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-e8a50111-4e2b-4385-b7ed-0b5f1152ed59-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-e8a50111-4e2b-4385-b7ed-0b5f1152ed59-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4860d-4b59-4714-970d-5fcb8ab98928]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:08 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 Jul 14 20:28:08 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:09 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" returned: 0 in 0.668s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:09 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59 Jul 14 20:28:09 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:09 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" returned: 0 in 0.389s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-e8a50111-4e2b-4385-b7ed-0b5f1152ed59" released by "delete_volume" :: held 1.153s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['158159e9-310e-4831-b70e-8fcb7bc12755', '63fdc0f2-67c5-4ca0-b280-39d1434c5d50', 'dab50af6-ae13-4cd2-bba9-8abcc2839cd7', 'cb4f3ecd-44d3-4901-b0e3-3c101fed2123'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:10 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:10 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:10 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.457s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f92e0320-995d-4bdd-aeec-1b85ace9be24 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-e8a50111-4e2b-4385-b7ed-0b5f1152ed59-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:10 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302" returned: 0 in 4.711s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900b05f-b4c1-406c-9706-437bb50fe431]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:10 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:10 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[530c2f47-8428-4d5e-8c88-c3baffa08186]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:10 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c Jul 14 20:28:10 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:11 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:11 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.577s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:28:11 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Converted 1024.00 MB image at 217.32 MB/s Jul 14 20:28:11 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 is being set with open permissions: ugo+rw Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:11 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c Jul 14 20:28:11 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:11 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 Jul 14 20:28:11 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:11 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" returned: 0 in 0.252s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c" released by "delete_volume" :: held 0.669s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:11 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" released by "_copy_volume_from_snapshot" :: held 6.349s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-8248d7da-11dd-45ad-aa15-4ecec1fdbf62" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-8248d7da-11dd-45ad-aa15-4ecec1fdbf62" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Deleting offline snapshot 8248d7da-11dd-45ad-aa15-4ecec1fdbf62 of volume 8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] snapshot_file for this snap is: volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[55044b3a-952a-4d3c-bd32-f7b000f614a4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['9bfdc650-e231-4452-a114-85bdb1b66fa5', 'caf74ace-037e-44a4-9e5c-1ec08fa70d53', '853d1a68-990d-4d88-9114-faf1a7bbccf2', '41f72c4e-4a1a-460c-b5d7-26351930ec57'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:11 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:11 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:11 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:11 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-b7bb2bfc-89ac-4912-9903-8a7f43351cec-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-b7bb2bfc-89ac-4912-9903-8a7f43351cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:11 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-b7bb2bfc-89ac-4912-9903-8a7f43351cec" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8817fbf3-a871-4ab1-9960-89ae767a1fdc tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-8c5e9f4e-4d62-4d9c-88bb-e7624e70b11c-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-b7bb2bfc-89ac-4912-9903-8a7f43351cec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleting offline snapshot b7bb2bfc-89ac-4912-9903-8a7f43351cec of volume 18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:28:11 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] snapshot_file for this snap is: volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.420s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6b744-509b-46dc-b74b-ee2fd133c3b6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0419dc29-c092-4f2f-b77b-50e3f5476a82]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:12 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec Jul 14 20:28:12 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:12 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:12 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18252c8a-dee8-4828-b252-0822750cc724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b2b49-f584-4b7e-b465-dccc0f841259]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:12 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:12 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 Jul 14 20:28:12 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:12 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62 Jul 14 20:28:12 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:12 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec Jul 14 20:28:12 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:12 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5.8248d7da-11dd-45ad-aa15-4ecec1fdbf62" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-8248d7da-11dd-45ad-aa15-4ecec1fdbf62" released by "_delete_snapshot" :: held 1.493s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.902s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.226s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e638b8c-7b95-464d-8497-394ba22bc862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f459501b-08b2-45bb-8629-232a83d08302', 'volume_size': 1, 'source_volid': '8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5', 'source_volstatus': 'available'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f31112-8861-4dfd-b8e4-ebe34226255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[854060d1-92e0-4898-ae1b-74b87af49a57]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:13 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Volume volume-f459501b-08b2-45bb-8629-232a83d08302 (f459501b-08b2-45bb-8629-232a83d08302): created successfully Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f31112-8861-4dfd-b8e4-ebe34226255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (b6f61f29-8465-4043-9b22-7a3b4b7b5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7734807f-2e93-4348-92fc-93484ade7a45 tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:28:13 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:13 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec Jul 14 20:28:13 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:13 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:28:13 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:13 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724.b7bb2bfc-89ac-4912-9903-8a7f43351cec" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-b7bb2bfc-89ac-4912-9903-8a7f43351cec" released by "_delete_snapshot" :: held 1.483s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" released by "delete_snapshot" :: held 1.510s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:13 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.413s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['7b7bb5da-d83f-4b27-ae28-5694870d7f6c', '38ccd390-0874-4a13-bab9-bc50ed9b7981', '1f4ce619-26fc-404f-88bb-9641a04fb889', '20bc43f0-f96a-43c4-82aa-67697e7f97a0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5485d04-5175-4228-8e82-27b8a451122c', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:28:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Delete snapshot completed successfully. Jul 14 20:28:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-f2187dfc-09ba-4543-b6ef-d2bc71d0a0c1 req-9ac27d94-3a7b-4ad6-8a71-f07361af058f tempest-TestStampPattern-1766617191 None] attachment_update completed successfully. Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5129c73d-07bb-483d-b300-7b1d106cfb45 tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-b7bb2bfc-89ac-4912-9903-8a7f43351cec-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-18252c8a-dee8-4828-b252-0822750cc724-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-18252c8a-dee8-4828-b252-0822750cc724-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" acquired by "delete_volume" :: waited 0.048s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78404e0-04ea-41b6-bf22-d91ddd30d7b1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:14 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 Jul 14 20:28:14 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (436bf448-5e91-4638-b834-80f76a91c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b82a3c-ab5e-4c5a-aeb1-f37f665fbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b82a3c-ab5e-4c5a-aeb1-f37f665fbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-856248216',display_name='tempest-VolumesGetTest-Volume-1844318759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ceef9c8-3cab-43ec-8e61-bd9b004a664c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:14Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6db2ac2-d137-46bf-93c1-1ce3ff2ead3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6db2ac2-d137-46bf-93c1-1ce3ff2ead3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575bc79d-f5d4-4ad9-9f2c-16adeef73ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575bc79d-f5d4-4ad9-9f2c-16adeef73ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ceef9c8-3cab-43ec-8e61-bd9b004a664c', 'volume_name': 'volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bea337-dbb0-4036-a99e-f379a62079c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bea337-dbb0-4036-a99e-f379a62079c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9117fa-0f8b-485f-9ffa-d511a5bb8b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Volume 5ceef9c8-3cab-43ec-8e61-bd9b004a664c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c', 'volume_size': 1} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-856248216',display_name='tempest-VolumesGetTest-Volume-1844318759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ceef9c8-3cab-43ec-8e61-bd9b004a664c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:14Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Creating volume 5ceef9c8-3cab-43ec-8e61-bd9b004a664c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:14 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:14 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c 1073741824 Jul 14 20:28:14 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:14 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:14 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724 Jul 14 20:28:14 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:14 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-18252c8a-dee8-4828-b252-0822750cc724" returned: 0 in 0.317s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-quobyte-18252c8a-dee8-4828-b252-0822750cc724" released by "delete_volume" :: held 0.807s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Created reservations ['06810c19-4310-475e-bfa5-dd667d21ef63', '0b68a9e8-b77f-40e0-b60e-4a1e1e3d2b17', '559c7270-9126-4860-aa3a-96697a836f9a', '20cce67e-902b-43ac-885d-4c5bcf66abf8'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:14 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c 1073741824" returned: 0 in 0.478s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:15 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c Jul 14 20:28:15 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:15 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:15 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:15 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" returned: 0 in 0.347s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:15 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9117fa-0f8b-485f-9ffa-d511a5bb8b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20ba9c1-06d2-42aa-8110-673aed289903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Deleted volume successfully. Jul 14 20:28:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Volume volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c (5ceef9c8-3cab-43ec-8e61-bd9b004a664c): created successfully Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20ba9c1-06d2-42aa-8110-673aed289903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (436bf448-5e91-4638-b834-80f76a91c02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0aaad1b6-1a50-40a9-b444-14b310368e6a tempest-CreateVolumesFromSnapshotTest-2094252788 None] Lock "cinder-18252c8a-dee8-4828-b252-0822750cc724-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6c08e500-c3b5-4ef6-ba97-76b59e8614e3 tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-5ceef9c8-3cab-43ec-8e61-bd9b004a664c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "cinder-5ceef9c8-3cab-43ec-8e61-bd9b004a664c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbb598-502b-4dfa-8fce-e52d00badc1f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:16 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c Jul 14 20:28:16 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:17 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" returned: 0 in 0.426s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:17 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c Jul 14 20:28:17 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:17 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-5ceef9c8-3cab-43ec-8e61-bd9b004a664c" released by "delete_volume" :: held 0.753s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Created reservations ['06963673-18ab-4d07-9484-dba83b07b4c1', 'b382cf6a-932d-425a-960b-2439af5fde95', '20df44e3-c818-426b-ac8a-c5a4aa4d7279', 'd7705e46-e0ca-4727-971b-fbfa057ea921'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:17 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:17 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-f459501b-08b2-45bb-8629-232a83d08302-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "cinder-f459501b-08b2-45bb-8629-232a83d08302-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:18 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.361s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-36f9e799-8aa2-455f-99ad-d7b258fcf61f tempest-VolumesGetTest-1891638670 None] Lock "cinder-5ceef9c8-3cab-43ec-8e61-bd9b004a664c-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b023d5f-acd2-4720-98bf-f352b3908306]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:18 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 Jul 14 20:28:18 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (7ca90eff-9719-4bdb-9a46-e0b6bf6b8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777ae6be-a4fe-494d-a079-7830a3b9c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777ae6be-a4fe-494d-a079-7830a3b9c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2051362289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda9ecca-5d84-4d43-bfc2-340552a2d868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:18Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b70fc84-2264-4d50-90ca-67b2e8aa99b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b70fc84-2264-4d50-90ca-67b2e8aa99b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2b482-afc9-48bc-b838-f5f236c7433b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2b482-afc9-48bc-b838-f5f236c7433b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda9ecca-5d84-4d43-bfc2-340552a2d868', 'volume_name': 'volume-dda9ecca-5d84-4d43-bfc2-340552a2d868', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681938c8-19df-4781-b111-644f80fab721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681938c8-19df-4781-b111-644f80fab721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8aa2c6-edcc-4354-b545-9d2e46203820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:18 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume dda9ecca-5d84-4d43-bfc2-340552a2d868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda9ecca-5d84-4d43-bfc2-340552a2d868', 'volume_size': 1} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2051362289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda9ecca-5d84-4d43-bfc2-340552a2d868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:18Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume dda9ecca-5d84-4d43-bfc2-340552a2d868 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:18 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:18 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 1073741824 Jul 14 20:28:18 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-ab833de3-8edd-4a5f-bdb5-c3037e7e1e83 req-63feb307-8230-4718-a310-9c701a978ba5 tempest-TestStampPattern-1766617191 None] Terminate volume connection completed successfully. Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-ab833de3-8edd-4a5f-bdb5-c3037e7e1e83 req-63feb307-8230-4718-a310-9c701a978ba5 tempest-TestStampPattern-1766617191 None] Deleting attachment e5485d04-5175-4228-8e82-27b8a451122c. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:28:18 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:18 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302 Jul 14 20:28:18 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:18 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f459501b-08b2-45bb-8629-232a83d08302" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-f459501b-08b2-45bb-8629-232a83d08302" released by "delete_volume" :: held 0.777s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Created reservations ['3cb4113e-e444-40d0-b464-2462a720a9ee', 'e35a945f-62b8-4405-a902-0ba8debbef52', '0d9b11b3-651b-45b9-b6c1-0e324b69f151', '2e5841bf-aaf5-4ebc-b08c-b07120af8689'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:19 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 1073741824" returned: 0 in 0.469s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:19 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 Jul 14 20:28:19 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:19 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "cinder-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:19 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.336s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:19 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868" returned: 0 in 0.390s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.104s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8aa2c6-edcc-4354-b545-9d2e46203820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda9ecca-5d84-4d43-bfc2-340552a2d868', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935e8f14-bf86-40a6-8e18-b2ee0a4ed909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Creating offline snapshot 827f784e-cab4-4e66-948e-1fe1151cb450 of volume 4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdec654-b376-4b9f-bfcc-62c07fe0c292]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-48c04f00-2e8e-44b0-9a04-91b1c98b71a2 tempest-VolumesGetTest-1891638670 None] Lock "cinder-f459501b-08b2-45bb-8629-232a83d08302-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1129d9-401a-4232-8ff3-f23e435fdafc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 (dda9ecca-5d84-4d43-bfc2-340552a2d868): created successfully Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935e8f14-bf86-40a6-8e18-b2ee0a4ed909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (7ca90eff-9719-4bdb-9a46-e0b6bf6b8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-efdd59da-932a-43a4-8b51-ef1bd64c1c00 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:19 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:28:19 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:19 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:19 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:19 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.374s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:19 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 1G Jul 14 20:28:19 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:19 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5 Jul 14 20:28:19 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:20 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5" released by "delete_volume" :: held 0.701s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Created reservations ['25dcdf0d-d944-4d11-b1e1-c42578478630', '1b98f8c4-5555-461f-9416-456f256c59bd', 'df0444f6-8a84-4cb5-8310-2a4e6483d6af', 'd794c33e-4ea2-49ba-bc01-7596397e66d7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:20 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 1G" returned: 0 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:20 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:20 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:20 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:28:20 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:20 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8183daf8-4d3e-4176-97b1-dfa435245aa0 tempest-VolumesGetTest-1891638670 None] Lock "cinder-8d9a3e9d-140c-4ba2-8083-7c53e9a59ed5-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:20 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:20 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 is being set with open permissions: ugo+rw Jul 14 20:28:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:20 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:28:20 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:21 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.304s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:21 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info Jul 14 20:28:21 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (083f04e2-9132-4c65-8e55-ca77bf69969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abccdc2b-036e-4006-a72d-6007c29345c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abccdc2b-036e-4006-a72d-6007c29345c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867993676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21fdcef-837d-44ff-84b5-fd1102a3739c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:21Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ecc4d-c069-4110-87b7-ccd98387c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ecc4d-c069-4110-87b7-ccd98387c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1413b1c-5eac-4933-8ed6-fdea5537024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1413b1c-5eac-4933-8ed6-fdea5537024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21fdcef-837d-44ff-84b5-fd1102a3739c', 'volume_name': 'volume-f21fdcef-837d-44ff-84b5-fd1102a3739c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb93730-c961-470b-bc73-adc8904758f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb93730-c961-470b-bc73-adc8904758f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198d549a-43e8-4e6d-9480-16bcceddce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume f21fdcef-837d-44ff-84b5-fd1102a3739c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21fdcef-837d-44ff-84b5-fd1102a3739c', 'volume_size': 1} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:21 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info" returned: 0 in 0.343s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:21 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info is being set with open permissions: ugo+rw Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:21 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info Jul 14 20:28:21 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:21 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.info" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867993676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21fdcef-837d-44ff-84b5-fd1102a3739c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:21Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume f21fdcef-837d-44ff-84b5-fd1102a3739c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:21 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:21 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c 1073741824 Jul 14 20:28:21 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-98e4811d-be91-4d36-9c19-b262e459e5fb tempest-TestStampPattern-1766617191 None] Create snapshot completed successfully Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (26a17f82-e8b8-4a1a-a570-a4a4b01f51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2563e44-4b94-40c3-a943-85338bfa4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2563e44-4b94-40c3-a943-85338bfa4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522867733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402864c-f57c-44e8-af11-c000ac145573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283a98d4-cac0-4bfb-aed0-e6a83126e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283a98d4-cac0-4bfb-aed0-e6a83126e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0cdde7-9111-485a-802e-a009c00737d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0cdde7-9111-485a-802e-a009c00737d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4402864c-f57c-44e8-af11-c000ac145573', 'volume_name': 'volume-4402864c-f57c-44e8-af11-c000ac145573', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e478870-2c35-4309-a566-1fa59a87c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e478870-2c35-4309-a566-1fa59a87c300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b67e7a5-a665-4570-952d-932eacd02da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume 4402864c-f57c-44e8-af11-c000ac145573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4402864c-f57c-44e8-af11-c000ac145573', 'volume_size': 1} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:22 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c 1073741824" returned: 0 in 0.513s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:22 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c Jul 14 20:28:22 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (dcd9fda7-5873-40c1-b9d3-f1d1bae15903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a818f89-098e-4e14-b7e3-ccc7d0f73f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a818f89-098e-4e14-b7e3-ccc7d0f73f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1655735628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4602abc-2307-40ec-b611-a43fda522598,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b6119a-5486-443c-85f7-5a343af6fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b6119a-5486-443c-85f7-5a343af6fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82df1352-38a7-4108-a56e-6aeb03228120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (6a169186-9221-47ce-8e64-a0b2ff9de595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c461ac-4e4d-4b14-8a29-7247e28aa641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c461ac-4e4d-4b14-8a29-7247e28aa641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185908808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0732ecf6-d98d-40b0-b347-cad8353ca4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b026cb26-34cf-427b-8a78-237a39a04717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b026cb26-34cf-427b-8a78-237a39a04717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa62979-fbc5-4c86-bd15-c1e0ca5f08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa62979-fbc5-4c86-bd15-c1e0ca5f08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0732ecf6-d98d-40b0-b347-cad8353ca4dc', 'volume_name': 'volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f72251-36f9-4b65-8254-5b3ce5e33bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f72251-36f9-4b65-8254-5b3ce5e33bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c802ab8-afbe-4415-ae19-f0397809c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume 0732ecf6-d98d-40b0-b347-cad8353ca4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc', 'volume_size': 1} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (d21bf912-0ebb-40c0-9db9-1642f1d2fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ba4986-18b2-44f6-9284-b0817c4f3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522867733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402864c-f57c-44e8-af11-c000ac145573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume 4402864c-f57c-44e8-af11-c000ac145573 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:22 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198d549a-43e8-4e6d-9480-16bcceddce77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21fdcef-837d-44ff-84b5-fd1102a3739c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f689e311-4def-4c95-bc1d-604371d2aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 1073741824 Jul 14 20:28:22 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ba4986-18b2-44f6-9284-b0817c4f3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129206282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5a31e0-17e3-48bf-b313-1d9b6961b44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:23Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5424a2e6-8ad1-40df-b804-3c40173b2296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5424a2e6-8ad1-40df-b804-3c40173b2296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c92b6-8052-4360-a676-0e0d30cddc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c92b6-8052-4360-a676-0e0d30cddc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5a31e0-17e3-48bf-b313-1d9b6961b44e', 'volume_name': 'volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298d633d-4a80-4bd3-a7a7-f5e41cc57e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298d633d-4a80-4bd3-a7a7-f5e41cc57e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fc4f98-0c6a-4509-bb93-6f86f158cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume 4d5a31e0-17e3-48bf-b313-1d9b6961b44e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e', 'volume_size': 1} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-f21fdcef-837d-44ff-84b5-fd1102a3739c (f21fdcef-837d-44ff-84b5-fd1102a3739c): created successfully Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f689e311-4def-4c95-bc1d-604371d2aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (083f04e2-9132-4c65-8e55-ca77bf69969f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (0015ce8c-5a8d-40bb-b15c-39e6c3df54b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41810e0-f9b9-4aca-b49a-7b23acdb1575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bf9f5cd8-1421-476a-ac3d-447b785f812f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41810e0-f9b9-4aca-b49a-7b23acdb1575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699166749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dc2412-79d5-4874-9123-759200b6e97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:23Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5552f71-29b8-4e45-8d15-7048a31a9cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5552f71-29b8-4e45-8d15-7048a31a9cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5091214-3c23-41f6-9dcf-8881208ed7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5091214-3c23-41f6-9dcf-8881208ed7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3dc2412-79d5-4874-9123-759200b6e97b', 'volume_name': 'volume-f3dc2412-79d5-4874-9123-759200b6e97b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e0499-cda5-4881-971c-4f0bda235ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e0499-cda5-4881-971c-4f0bda235ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e41e3f-727b-4195-9462-2e0a20b02808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume f3dc2412-79d5-4874-9123-759200b6e97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3dc2412-79d5-4874-9123-759200b6e97b', 'volume_size': 1} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82df1352-38a7-4108-a56e-6aeb03228120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4602abc-2307-40ec-b611-a43fda522598', 'volume_name': 'volume-c4602abc-2307-40ec-b611-a43fda522598', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6698ce-ab30-4494-809d-9402fecfb35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6698ce-ab30-4494-809d-9402fecfb35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bc1134-4894-40f9-a502-26fc8e763884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Volume c4602abc-2307-40ec-b611-a43fda522598: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4602abc-2307-40ec-b611-a43fda522598', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Trying to clone c4602abc-2307-40ec-b611-a43fda522598 from image a28aaf9a-7579-4123-bee1-aab6e137d44e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:28:23 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 1073741824" returned: 0 in 0.622s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Image download 20.69 MB at 20.69 MB/s Jul 14 20:28:23 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 Jul 14 20:28:23 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed19fbb5-c951-43af-822b-e91e0bf90229]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:23 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD Jul 14 20:28:23 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573" returned: 0 in 0.350s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185908808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0732ecf6-d98d-40b0-b347-cad8353ca4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume 0732ecf6-d98d-40b0-b347-cad8353ca4dc {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:23 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc 1073741824 Jul 14 20:28:23 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b67e7a5-a665-4570-952d-932eacd02da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4402864c-f57c-44e8-af11-c000ac145573', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af444f9c-14a3-478d-9594-ed2360cfe5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-4402864c-f57c-44e8-af11-c000ac145573 (4402864c-f57c-44e8-af11-c000ac145573): created successfully Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af444f9c-14a3-478d-9594-ed2360cfe5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (26a17f82-e8b8-4a1a-a570-a4a4b01f51fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9de47b3c-1e1d-4765-8528-7d9615963520 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:24 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e is fetched for user b555b83535734c8abab3bc150e63dcae. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad5fc2-8d82-457f-9450-e3f89f6307f7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:24 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD Jul 14 20:28:24 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:24 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc 1073741824" returned: 0 in 0.578s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:24 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:24 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc Jul 14 20:28:24 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:24 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.877s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129206282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5a31e0-17e3-48bf-b313-1d9b6961b44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:23Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume 4d5a31e0-17e3-48bf-b313-1d9b6961b44e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c802ab8-afbe-4415-ae19-f0397809c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:24 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e 1073741824 Jul 14 20:28:24 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f75dfb-43e1-44d7-886f-d0845831a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc (0732ecf6-d98d-40b0-b347-cad8353ca4dc): created successfully Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f75dfb-43e1-44d7-886f-d0845831a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (6a169186-9221-47ce-8e64-a0b2ff9de595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-57f9e1be-ad0e-40c9-a623-9ef3e6b8f745 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:25 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e 1073741824" returned: 0 in 0.473s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:25 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e Jul 14 20:28:25 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:25 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699166749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dc2412-79d5-4874-9123-759200b6e97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d12781ceb7413aa1b3447dbb4f4995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:23Z,use_quota=True,user_id='e0f334081965435fb21e4d2b18d99251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Creating volume f3dc2412-79d5-4874-9123-759200b6e97b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:25 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:25 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b 1073741824 Jul 14 20:28:25 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fc4f98-0c6a-4509-bb93-6f86f158cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd425ee5-e96c-46e6-9d04-ff939e536a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e (4d5a31e0-17e3-48bf-b313-1d9b6961b44e): created successfully Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd425ee5-e96c-46e6-9d04-ff939e536a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (d21bf912-0ebb-40c0-9db9-1642f1d2fd03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f9368ef1-c9c9-4ccd-b19f-5efa0b43766f tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:26 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b 1073741824" returned: 0 in 0.474s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:26 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b Jul 14 20:28:26 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:26 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1655735628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4602abc-2307-40ec-b611-a43fda522598,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:22Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Creating volume c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:26 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e41e3f-727b-4195-9462-2e0a20b02808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3dc2412-79d5-4874-9123-759200b6e97b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:26 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1073741824 Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de15839-085e-4f6e-a83e-6a3780a7dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:26 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Volume volume-f3dc2412-79d5-4874-9123-759200b6e97b (f3dc2412-79d5-4874-9123-759200b6e97b): created successfully Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de15839-085e-4f6e-a83e-6a3780a7dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Flow 'volume_create_manager' (0015ce8c-5a8d-40bb-b15c-39e6c3df54b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e7b3f009-a358-4823-9235-9bbb8e571144 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created volume successfully. Jul 14 20:28:26 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1073741824" returned: 0 in 0.478s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:26 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:26 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:27 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Attempting download of a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume c4602abc-2307-40ec-b611-a43fda522598. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eac6221-6e2d-4c58-a968-546546ac69a2]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:27 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x Jul 14 20:28:27 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-f3dc2412-79d5-4874-9123-759200b6e97b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-f3dc2412-79d5-4874-9123-759200b6e97b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-f3dc2412-79d5-4874-9123-759200b6e97b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-f3dc2412-79d5-4874-9123-759200b6e97b" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:27 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02c472b-e7dc-46f8-8a2a-76fca3c02f06]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:27 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x Jul 14 20:28:27 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:27 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b Jul 14 20:28:27 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:27 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x" returned: 1 in 0.373s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_jd4tde_x' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[14583eb3-aa75-4042-bdc6-a3c691fe01e8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:28 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b" returned: 0 in 0.444s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:28 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b Jul 14 20:28:28 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:28 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD Jul 14 20:28:28 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:28 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:28 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f3dc2412-79d5-4874-9123-759200b6e97b" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] a28aaf9a-7579-4123-bee1-aab6e137d44e was qcow2, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-f3dc2412-79d5-4874-9123-759200b6e97b" released by "delete_volume" :: held 0.798s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:28 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:28 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['15746a38-460c-4f3d-add7-cde7e006f2f7', '742ad32e-102f-4b3d-909a-33862d09c356', '2b144e24-4c3e-4267-a387-6c4b9f27f49f', '88157f6f-5b8f-4f20-a6b7-7a6a746863d3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:28 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:28 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-4d5a31e0-17e3-48bf-b313-1d9b6961b44e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-4d5a31e0-17e3-48bf-b313-1d9b6961b44e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e640136-8e7c-4ea6-9fce-ad988675c36d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:28 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6017419e-2ac8-4381-be03-1892286bf634 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-f3dc2412-79d5-4874-9123-759200b6e97b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:29 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e Jul 14 20:28:29 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:29 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" returned: 0 in 0.452s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:29 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e Jul 14 20:28:29 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:29 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" returned: 0 in 0.333s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-4d5a31e0-17e3-48bf-b313-1d9b6961b44e" released by "delete_volume" :: held 0.839s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['e22d5a80-c1ad-4c38-bc06-bd741b0b2e5d', '0ac84cc8-0a05-42a0-8ce8-85514522948a', '1a85c744-bf84-4eaf-9da4-73396dabbaba', '7f245cc3-5988-4e0d-8b8f-d1eac972c645'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:29 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:29 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-0732ecf6-d98d-40b0-b347-cad8353ca4dc-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-0732ecf6-d98d-40b0-b347-cad8353ca4dc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Flow 'volume_create_manager' (e617cc3b-1ff8-4523-b6c1-ef2a50410815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae52d40-9fca-4a5a-a342-4c5345f45aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae52d40-9fca-4a5a-a342-4c5345f45aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1629472470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf58ecf-a8a0-437b-85a8-6194ecf4800e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3258156016334dfdabb95485b0fa050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=827f784e-cab4-4e66-948e-1fe1151cb450,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:30Z,use_quota=True,user_id='3cad5b30378447e9bff75fc258639892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5670d7-028f-40e7-95a2-df1b9d763997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:30 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5670d7-028f-40e7-95a2-df1b9d763997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43e903-79a7-4552-acf2-666a46f29147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43e903-79a7-4552-acf2-666a46f29147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cf58ecf-a8a0-437b-85a8-6194ecf4800e', 'volume_name': 'volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e', 'volume_size': 1, 'snapshot_id': '827f784e-cab4-4e66-948e-1fe1151cb450'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959593b-b44f-44d7-a0fd-f9eddb13e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959593b-b44f-44d7-a0fd-f9eddb13e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9e0c99-f852-4b78-9bf8-8affc310e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:30 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Volume 0cf58ecf-a8a0-437b-85a8-6194ecf4800e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e', 'volume_size': 1, 'snapshot_id': '827f784e-cab4-4e66-948e-1fe1151cb450'} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.434s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-0732ecf6-d98d-40b0-b347-cad8353ca4dc" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-0732ecf6-d98d-40b0-b347-cad8353ca4dc" acquired by "delete_volume" :: waited 0.050s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:30 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 0 in 1.942s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_gvwc633mdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:28:30 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Converted 112.00 MB image at 57.64 MB/s Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3c44239-5333-4c8c-b6f3-e3d8fe8db284 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-4d5a31e0-17e3-48bf-b313-1d9b6961b44e-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Creating volume 0cf58ecf-a8a0-437b-85a8-6194ecf4800e from snapshot 827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6215d42-23ad-4fbd-8bae-d7298cb6b1c4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:30 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1G Jul 14 20:28:30 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] snapshot: 827f784e-cab4-4e66-948e-1fe1151cb450, volume: 0cf58ecf-a8a0-437b-85a8-6194ecf4800e, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[974516ad-5724-48ae-a932-87089456f07c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:30 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc Jul 14 20:28:30 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:30 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:28:30 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:30 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 1G" returned: 0 in 0.363s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af55626-ddbc-437a-ad7f-297d389289bd]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:30 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc" returned: 0 in 0.419s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:30 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc Jul 14 20:28:30 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:30 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:30 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:30 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.441s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087c0b7-3be8-4423-a058-e8ac58d902e7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:31 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:28:31 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:31 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0732ecf6-d98d-40b0-b347-cad8353ca4dc" returned: 0 in 0.343s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-0732ecf6-d98d-40b0-b347-cad8353ca4dc" released by "delete_volume" :: held 0.851s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:31 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 0 in 0.522s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['3a793731-8dd9-4026-b60c-2f7e9404917a', 'c03c1399-5806-4b91-94d9-8b7a9f3f4f6a', '2313de17-3ccf-44f9-b6d8-50e563d1b01b', '335fc6d0-bce6-4ee6-9c32-200d26a272ab'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:31 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:31 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:31 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:31 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:31 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.500s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:31 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e Jul 14 20:28:31 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:31 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 1 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Downloaded image a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume c4602abc-2307-40ec-b611-a43fda522598 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e for user b555b83535734c8abab3bc150e63dcae is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Marking volume c4602abc-2307-40ec-b611-a43fda522598 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:28:31 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Copying metadata from image a28aaf9a-7579-4123-bee1-aab6e137d44e to c4602abc-2307-40ec-b611-a43fda522598. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Creating volume glance metadata for volume c4602abc-2307-40ec-b611-a43fda522598 backed by image a28aaf9a-7579-4123-bee1-aab6e137d44e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c593e951-4e4b-4c13-aa44-3c0bb02157f4 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-0732ecf6-d98d-40b0-b347-cad8353ca4dc-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bc1134-4894-40f9-a502-26fc8e763884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4602abc-2307-40ec-b611-a43fda522598', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a4068e-310b-4071-a8bc-b85b02068006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:31 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Volume volume-c4602abc-2307-40ec-b611-a43fda522598 (c4602abc-2307-40ec-b611-a43fda522598): created successfully Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a4068e-310b-4071-a8bc-b85b02068006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:31 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (dcd9fda7-5873-40c1-b9d3-f1d1bae15903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5c998cdb-a2eb-4e9d-bf67-64a19d9f8e78 tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:28:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-4402864c-f57c-44e8-af11-c000ac145573-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-4402864c-f57c-44e8-af11-c000ac145573-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-4402864c-f57c-44e8-af11-c000ac145573" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-4402864c-f57c-44e8-af11-c000ac145573" acquired by "delete_volume" :: waited 0.047s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7e4b8-2fd2-4b68-a962-5e893be4471c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:33 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 Jul 14 20:28:33 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:34 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573" returned: 0 in 1.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:34 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573 Jul 14 20:28:34 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:35 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (dfa603bf-ef58-4db7-881d-9079d80fd01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ce343-d1a1-41de-942b-d75288f4597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4402864c-f57c-44e8-af11-c000ac145573" returned: 0 in 0.990s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ce343-d1a1-41de-942b-d75288f4597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-458850515',display_name='tempest-VolumesGetTest-Volume-293563094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7a8ddd-2ece-4dab-b425-1e4a94c098ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:35Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa0f22a-4fdd-4dc2-828b-055c4b7a58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa0f22a-4fdd-4dc2-828b-055c4b7a58c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52fa01-5b4e-4f5b-89da-de3254a39d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52fa01-5b4e-4f5b-89da-de3254a39d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7a8ddd-2ece-4dab-b425-1e4a94c098ac', 'volume_name': 'volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda79d58-d302-4803-9e41-73084e043be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda79d58-d302-4803-9e41-73084e043be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c60f2d8-c4ba-4585-af9f-2f515e1c535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:35 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Volume 9e7a8ddd-2ece-4dab-b425-1e4a94c098ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac', 'volume_size': 1} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-4402864c-f57c-44e8-af11-c000ac145573" released by "delete_volume" :: held 2.715s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['1ed97f56-ac06-40dd-a81a-a4d19031248f', '17b93ab1-a479-42aa-952a-d275ee2441b6', 'fddffcdd-c9fe-4296-a864-e7430fb5dda2', '589a2dd2-6a26-4246-b361-e898bb8e4aeb'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:36 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:36 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-f21fdcef-837d-44ff-84b5-fd1102a3739c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-f21fdcef-837d-44ff-84b5-fd1102a3739c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-f21fdcef-837d-44ff-84b5-fd1102a3739c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-f21fdcef-837d-44ff-84b5-fd1102a3739c" acquired by "delete_volume" :: waited 0.056s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:36 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.748s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62895c3-97d7-487e-b336-072429d1d9dd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-06713c08-9f5c-4ea8-86dc-e87340f9c46c tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-4402864c-f57c-44e8-af11-c000ac145573-delete_volume" released by "delete_volume" :: held 4.423s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:37 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c Jul 14 20:28:37 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:37 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" returned: 0 in 6.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd37896d-ebca-4981-9f27-962a3cacbc41]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:37 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c" returned: 0 in 0.895s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:37 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c Jul 14 20:28:37 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:37 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:28:37 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:38 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f21fdcef-837d-44ff-84b5-fd1102a3739c" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-f21fdcef-837d-44ff-84b5-fd1102a3739c" released by "delete_volume" :: held 1.300s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['27d66239-d819-4786-bc97-1f58addab787', '6cd3173b-c049-4144-adda-1858d2202a62', '2ce71c8e-725e-4d40-9707-5fcdf87e9bbb', '43609593-2431-463d-87ea-a289429492be'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:38 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:38 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:38 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.723s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:28:38 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Converted 1024.00 MB image at 160.18 MB/s Jul 14 20:28:38 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e is being set with open permissions: ugo+rw Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:38 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e Jul 14 20:28:38 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:38 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.338s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a1f44af-b58a-421e-a984-74cb5ad7465a tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-f21fdcef-837d-44ff-84b5-fd1102a3739c-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:38 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" released by "_copy_volume_from_snapshot" :: held 8.505s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" released by "_create_volume_from_snapshot" :: held 8.560s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.625s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.263s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-458850515',display_name='tempest-VolumesGetTest-Volume-293563094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7a8ddd-2ece-4dab-b425-1e4a94c098ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7136396a23744219895eeb33c658f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:35Z,use_quota=True,user_id='b555b83535734c8abab3bc150e63dcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Creating volume 9e7a8ddd-2ece-4dab-b425-1e4a94c098ac {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:38 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:38 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac 1073741824 Jul 14 20:28:38 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9e0c99-f852-4b78-9bf8-8affc310e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e', 'volume_size': 1, 'snapshot_id': '827f784e-cab4-4e66-948e-1fe1151cb450'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da963e7-17dc-4798-82c8-7378047c3b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:39 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Volume volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e (0cf58ecf-a8a0-437b-85a8-6194ecf4800e): created successfully Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da963e7-17dc-4798-82c8-7378047c3b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Flow 'volume_create_manager' (e617cc3b-1ff8-4523-b6c1-ef2a50410815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4cd02230-d89c-4166-9543-e463104e92c7 tempest-TestStampPattern-1766617191 None] Created volume successfully. Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-dda9ecca-5d84-4d43-bfc2-340552a2d868-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-dda9ecca-5d84-4d43-bfc2-340552a2d868-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "cinder-quobyte-dda9ecca-5d84-4d43-bfc2-340552a2d868" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-dda9ecca-5d84-4d43-bfc2-340552a2d868" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3853bf-0ee5-4b88-ace8-0e3eb73be408]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:39 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 Jul 14 20:28:39 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:39 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac 1073741824" returned: 0 in 0.574s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:39 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac Jul 14 20:28:39 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:39 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868" returned: 0 in 0.460s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:39 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868 Jul 14 20:28:39 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:39 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c60f2d8-c4ba-4585-af9f-2f515e1c535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0f77a8-cc9e-4921-b626-035dd9dd63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:40 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Volume volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac (9e7a8ddd-2ece-4dab-b425-1e4a94c098ac): created successfully Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0f77a8-cc9e-4921-b626-035dd9dd63ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Flow 'volume_create_manager' (dfa603bf-ef58-4db7-881d-9079d80fd01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ead1233d-bfb1-43a7-bb40-2b140559ed4d tempest-VolumesGetTest-1891638670 None] Created volume successfully. Jul 14 20:28:40 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dda9ecca-5d84-4d43-bfc2-340552a2d868" returned: 0 in 0.456s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-quobyte-dda9ecca-5d84-4d43-bfc2-340552a2d868" released by "delete_volume" :: held 0.982s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Created reservations ['d7cd218c-5970-4109-9a8f-ff0da95e421b', 'c5edb8d6-1411-4ad7-a6a0-606194637c99', 'da8ec8aa-919a-4571-b435-1c965eddab87', '152b07ca-eee8-4b2e-a948-d306afc36e12'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:40 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:40 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "cinder-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014a096-cf49-46b4-b1f2-b15a6d001acb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:40 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.419s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Deleted volume successfully. Jul 14 20:28:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9ab6f61c-fff5-48dd-9fbd-73717c4f4a71 tempest-CreateVolumesFromSourceVolumeTest-1192001186 None] Lock "cinder-dda9ecca-5d84-4d43-bfc2-340552a2d868-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:40 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac Jul 14 20:28:40 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:41 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" returned: 0 in 0.464s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:41 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac Jul 14 20:28:41 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:41 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac" released by "delete_volume" :: held 0.857s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Created reservations ['83cabbef-cbe7-434d-bb6c-9b2530925082', '35dc856a-e397-4ef0-8458-69750643259c', '5021d4bb-ba7c-4cf2-939f-045c81a0573f', '525d1663-bf91-43ec-af48-44b3568db8d2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:41 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:41 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-c4602abc-2307-40ec-b611-a43fda522598-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "cinder-c4602abc-2307-40ec-b611-a43fda522598-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:42 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:42 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Acquiring lock "cinder-quobyte-c4602abc-2307-40ec-b611-a43fda522598" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-c4602abc-2307-40ec-b611-a43fda522598" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-281c7736-4900-44a6-932e-595d8e02a44a tempest-VolumesGetTest-1891638670 None] Lock "cinder-9e7a8ddd-2ece-4dab-b425-1e4a94c098ac-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a7da97-ff91-45cc-8449-7e814fbf24b6]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:42 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:42 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:42 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 0 in 0.636s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:43 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:43 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:43 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 1 in 0.476s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:43 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598 Jul 14 20:28:43 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:43 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c4602abc-2307-40ec-b611-a43fda522598" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "cinder-quobyte-c4602abc-2307-40ec-b611-a43fda522598" released by "delete_volume" :: held 1.509s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=256,cinder:SELECT=191,cinder:DELETE=19,cinder:INSERT=61 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Created reservations ['d917287c-d3cb-43f7-bb2c-480ac28b3fbb', '6ad75666-9f42-4be2-aec5-56a484929197', '5ffa846b-9e55-4cbb-aa07-cf2c8bbb94c8', '407ec9a1-86a9-4a7d-8ff9-246b64cf7a0f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:44 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:44 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:44 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:44 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Deleted volume successfully. Jul 14 20:28:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f6001e2b-fe67-497c-9cec-eb228b6e0e31 tempest-VolumesGetTest-1891638670 None] Lock "cinder-c4602abc-2307-40ec-b611-a43fda522598-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Flow 'volume_create_manager' (288fab0d-b120-4566-8b2f-1203da4865e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000cc9b7-989b-407d-a0a5-c877a7e43798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000cc9b7-989b-407d-a0a5-c877a7e43798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df5d6f-0813-4bc4-af74-123a5103e83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db3641884d447cba83f05b64af1378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:46Z,use_quota=True,user_id='8586c14c2a7f4c78bae119ba5ddf5453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f685962-4c34-4d94-a9ec-1ae65e7737fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f685962-4c34-4d94-a9ec-1ae65e7737fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0bd4b-32da-45fc-b574-0a236c711efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c0bd4b-32da-45fc-b574-0a236c711efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82df5d6f-0813-4bc4-af74-123a5103e83f', 'volume_name': 'volume-82df5d6f-0813-4bc4-af74-123a5103e83f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871de2a-5c1c-4b66-9082-c61496a0e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871de2a-5c1c-4b66-9082-c61496a0e69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5620b354-9ee7-46d0-b18f-1e6c708d62df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Volume 82df5d6f-0813-4bc4-af74-123a5103e83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82df5d6f-0813-4bc4-af74-123a5103e83f', 'volume_size': 1} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df5d6f-0813-4bc4-af74-123a5103e83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db3641884d447cba83f05b64af1378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:46Z,use_quota=True,user_id='8586c14c2a7f4c78bae119ba5ddf5453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Creating volume 82df5d6f-0813-4bc4-af74-123a5103e83f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:45 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:45 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f 1073741824 Jul 14 20:28:45 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:46 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f 1073741824" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:46 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f Jul 14 20:28:46 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:46 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f" returned: 0 in 0.283s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5620b354-9ee7-46d0-b18f-1e6c708d62df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82df5d6f-0813-4bc4-af74-123a5103e83f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e412536-0407-4861-b0b9-f6e28242b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Volume volume-82df5d6f-0813-4bc4-af74-123a5103e83f (82df5d6f-0813-4bc4-af74-123a5103e83f): created successfully Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e412536-0407-4861-b0b9-f6e28242b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Flow 'volume_create_manager' (288fab0d-b120-4566-8b2f-1203da4865e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cd76b32f-af9c-43f9-897a-c3b3764c49b6 tempest-CinderUnicodeTest-111637642 None] Created volume successfully. Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Flow 'volume_create_manager' (eb05137b-e6af-4f62-96fa-117c03d8d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4302f8a0-29be-4119-8fb5-da1b8b55c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4302f8a0-29be-4119-8fb5-da1b8b55c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-249180681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e88fc-d600-4652-aa13-c186c36976da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156ff8b4a2144af5b36a3d463eda784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:48Z,use_quota=True,user_id='c5290fce61e34d218aa003376aebe26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7cca0a-5820-40e6-a923-e582a2180b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7cca0a-5820-40e6-a923-e582a2180b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a99d28-444a-40cc-aac2-3d99f555dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a99d28-444a-40cc-aac2-3d99f555dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3e88fc-d600-4652-aa13-c186c36976da', 'volume_name': 'volume-0a3e88fc-d600-4652-aa13-c186c36976da', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5442a-824d-4bb0-bc11-9216e9e89db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5442a-824d-4bb0-bc11-9216e9e89db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa8f917-f2f7-4e4a-8add-e15ae1989613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Volume 0a3e88fc-d600-4652-aa13-c186c36976da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3e88fc-d600-4652-aa13-c186c36976da', 'volume_size': 1} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-249180681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e88fc-d600-4652-aa13-c186c36976da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156ff8b4a2144af5b36a3d463eda784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:48Z,use_quota=True,user_id='c5290fce61e34d218aa003376aebe26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Creating volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:48 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:48 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da 1073741824 Jul 14 20:28:48 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Flow 'volume_create_manager' (a3f65d64-372c-4196-817d-f77e7b51940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabb5ee-925b-4437-a86b-1da0f6295b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dabb5ee-925b-4437-a86b-1da0f6295b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1866036747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef8a39b-6581-49a3-abf4-1f1c4da0c43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db3641884d447cba83f05b64af1378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:49Z,use_quota=True,user_id='8586c14c2a7f4c78bae119ba5ddf5453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e28343-f82d-46db-9152-452b69737e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e28343-f82d-46db-9152-452b69737e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e1c67f-8200-4cfa-8959-bcfd455d933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e1c67f-8200-4cfa-8959-bcfd455d933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef8a39b-6581-49a3-abf4-1f1c4da0c43b', 'volume_name': 'volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fa2007-2530-4461-b18c-316e9ff6e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fa2007-2530-4461-b18c-316e9ff6e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30063ff-0006-467b-a398-669cf1fd1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Volume 2ef8a39b-6581-49a3-abf4-1f1c4da0c43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b', 'volume_size': 1} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:48 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da 1073741824" returned: 0 in 0.499s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:48 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da Jul 14 20:28:48 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:49 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da" returned: 0 in 0.248s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.302s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:28:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1866036747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef8a39b-6581-49a3-abf4-1f1c4da0c43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db3641884d447cba83f05b64af1378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:28:49Z,use_quota=True,user_id='8586c14c2a7f4c78bae119ba5ddf5453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Creating volume 2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:28:49 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:49 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b 1073741824 Jul 14 20:28:49 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa8f917-f2f7-4e4a-8add-e15ae1989613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3e88fc-d600-4652-aa13-c186c36976da', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a444cc5e-f889-4956-bf1d-b651c30b2f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Volume volume-0a3e88fc-d600-4652-aa13-c186c36976da (0a3e88fc-d600-4652-aa13-c186c36976da): created successfully Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a444cc5e-f889-4956-bf1d-b651c30b2f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Flow 'volume_create_manager' (eb05137b-e6af-4f62-96fa-117c03d8d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f3fd898a-568f-4412-ab4e-b0f6d7d27e7c tempest-VolumesSnapshotListTestJSON-111327246 None] Created volume successfully. Jul 14 20:28:49 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b 1073741824" returned: 0 in 0.434s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:49 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b Jul 14 20:28:49 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:49 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30063ff-0006-467b-a398-669cf1fd1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055267ac-858d-4e53-bec4-f914d4bae48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:28:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Volume volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b (2ef8a39b-6581-49a3-abf4-1f1c4da0c43b): created successfully Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055267ac-858d-4e53-bec4-f914d4bae48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:28:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Flow 'volume_create_manager' (a3f65d64-372c-4196-817d-f77e7b51940c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:28:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-955e8976-3b12-4c79-9774-53d845add5bf tempest-CinderUnicodeTest-111637642 None] Created volume successfully. Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Creating offline snapshot 5854e776-3600-4fd7-864a-e54c67cb5e57 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e0a6e-fdfc-4eb7-88e4-25b58d547f19]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:50 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da Jul 14 20:28:50 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:50 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:50 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 1G Jul 14 20:28:50 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:51 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 1G" returned: 0 in 0.456s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:51 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:28:51 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:51 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:51 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 is being set with open permissions: ugo+rw Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:51 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:28:51 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:51 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:51 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info Jul 14 20:28:51 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:52 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info" returned: 0 in 0.263s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:52 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info is being set with open permissions: ugo+rw Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:52 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info Jul 14 20:28:52 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:52 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.info" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.499s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Creating offline snapshot 6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b of volume 2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d1389f2f-e6a9-484a-be40-06a1de56dab2 tempest-VolumesSnapshotListTestJSON-111327246 None] Create snapshot completed successfully Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b3ca0c-bfad-486f-9974-980fb7c62ced]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:52 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b Jul 14 20:28:52 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:52 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:52 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b 1G Jul 14 20:28:52 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:53 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b 1G" returned: 0 in 0.437s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:53 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b Jul 14 20:28:53 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:53 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" returned: 0 in 0.322s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b is being set with open permissions: ugo+rw Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:53 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b Jul 14 20:28:53 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:53 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:53 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info Jul 14 20:28:53 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:54 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info" returned: 0 in 0.272s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:54 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info is being set with open permissions: ugo+rw Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:54 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info Jul 14 20:28:54 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:54 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.info" returned: 0 in 0.235s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.642s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Creating offline snapshot a354c91d-3c3b-433e-8ffa-82faedd1acc1 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-25afe0f8-65a4-4c1a-8d3d-c6f9afbd07cb tempest-CinderUnicodeTest-111637642 None] Create snapshot completed successfully Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cb56d-be0f-405d-8ee5-7a194ffd39fd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:54 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:28:54 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:54 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:54 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 1G Jul 14 20:28:54 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-quobyte-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Deleting offline snapshot 6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b of volume 2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] snapshot_file for this snap is: volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03bef0-0661-46fc-99f1-d0dd2cfe72e3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:55 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b Jul 14 20:28:55 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:55 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 1G" returned: 0 in 0.483s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:55 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:28:55 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:55 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" returned: 0 in 0.390s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4971097a-f9c6-44ac-8f23-76b9706230db]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:55 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.294s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:55 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 is being set with open permissions: ugo+rw Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:55 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:28:55 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:55 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b Jul 14 20:28:55 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:55 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.523s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-deeefdd1-c36a-4c04-9391-72c20726fe1d tempest-VolumesSnapshotListTestJSON-111327246 None] Create snapshot completed successfully Jul 14 20:28:56 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" returned: 0 in 0.364s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:56 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b Jul 14 20:28:56 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:56 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" returned: 0 in 0.345s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:56 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b Jul 14 20:28:56 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:56 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b.6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b" released by "_delete_snapshot" :: held 1.465s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" released by "delete_snapshot" :: held 1.488s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Created reservations ['79f22bbb-e66b-402c-a902-e710b5ee9736', 'a6172cdf-86e8-4ccd-91cc-08ac1da83c9c', 'e1bfcb2b-d2d8-4423-997e-7b9e075269ad', '1499f3b6-e5b7-4ece-8601-768a7c69a6b4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Delete snapshot completed successfully. Jul 14 20:28:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-47eed37d-acd3-44b8-ada2-8140e164cb15 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-6fd41a67-2d7f-4afd-8d98-6afe7e0ca44b-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Creating offline snapshot 2a934128-4c86-4b41-9bb3-5f66029efc67 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf7302-167a-48d2-9b55-f0e85cb161cd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:57 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:28:57 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68aeb4-15d7-403e-8075-d9f51639e671]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:57 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:57 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 1G Jul 14 20:28:57 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:57 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b Jul 14 20:28:57 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:57 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" returned: 0 in 0.368s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:57 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b Jul 14 20:28:57 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:58 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 1G" returned: 0 in 0.454s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:58 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 Jul 14 20:28:58 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:58 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" returned: 0 in 0.261s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b" released by "delete_volume" :: held 0.692s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Created reservations ['2e6ffc5d-94f9-42b8-813d-ee6dda4ee723', '743ad673-5970-44ca-b65b-0dd50e36df73', '5464ae2d-276d-420b-8c46-ca42839a4514', '69585d24-f077-441b-8d5e-efea7ab8a534'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:58 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:58 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:58 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67" returned: 0 in 0.300s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:58 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 is being set with open permissions: ugo+rw Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:58 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 Jul 14 20:28:58 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:58 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-82df5d6f-0813-4bc4-af74-123a5103e83f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Deleted volume successfully. Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "cinder-82df5d6f-0813-4bc4-af74-123a5103e83f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-86e06809-867c-48ab-b5ff-79ad0cc5e053 tempest-CinderUnicodeTest-111637642 None] Lock "cinder-2ef8a39b-6581-49a3-abf4-1f1c4da0c43b-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Acquiring lock "cinder-quobyte-82df5d6f-0813-4bc4-af74-123a5103e83f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:28:58 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67" returned: 0 in 0.294s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-82df5d6f-0813-4bc4-af74-123a5103e83f" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.528s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca6f76-a633-418f-9757-3429f3716bef]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:28:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0f35f358-2216-4381-ab10-480e2442d63e tempest-VolumesSnapshotListTestJSON-111327246 None] Create snapshot completed successfully Jul 14 20:28:58 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f Jul 14 20:28:58 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:59 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:59 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f Jul 14 20:28:59 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:59 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-82df5d6f-0813-4bc4-af74-123a5103e83f" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "cinder-quobyte-82df5d6f-0813-4bc4-af74-123a5103e83f" released by "delete_volume" :: held 0.683s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Created reservations ['5d52a4cb-5dbc-410f-9267-790fe6828e85', 'ec63804b-adc8-4c81-b388-7732438eee4c', '0bc335b3-2373-4905-8bbc-b6699382335a', 'c662ef0d-81d6-4db4-b255-f8f57f1e47f7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:28:59 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:28:59 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:28:59 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.288s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:28:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Deleted volume successfully. Jul 14 20:28:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-26bb18e3-c5f6-4472-bc8f-7f2fe47118ad tempest-CinderUnicodeTest-111637642 None] Lock "cinder-82df5d6f-0813-4bc4-af74-123a5103e83f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-2a934128-4c86-4b41-9bb3-5f66029efc67-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-2a934128-4c86-4b41-9bb3-5f66029efc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-2a934128-4c86-4b41-9bb3-5f66029efc67" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-2a934128-4c86-4b41-9bb3-5f66029efc67" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Deleting offline snapshot 2a934128-4c86-4b41-9bb3-5f66029efc67 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] snapshot_file for this snap is: volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[371666dd-7658-4b6c-9ab2-977c4ccabf0b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:00 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 Jul 14 20:29:00 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:00 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67" returned: 0 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a688ddc0-9741-4830-96ff-df52eb83769e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:00 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:29:00 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:00 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:00 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 Jul 14 20:29:00 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:01 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:01 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67 Jul 14 20:29:01 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:01 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.2a934128-4c86-4b41-9bb3-5f66029efc67" returned: 0 in 0.249s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-2a934128-4c86-4b41-9bb3-5f66029efc67" released by "_delete_snapshot" :: held 1.582s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" released by "delete_snapshot" :: held 1.607s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Created reservations ['827a2b72-a739-450d-b3ea-ac8cfa929f47', 'e54a7b95-028d-4c0a-ace0-18f89289fbea', '151f07b6-29e2-46ff-94b0-a77d2942866a', '4ac45708-d81f-483e-9575-ae6850867f06'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Delete snapshot completed successfully. Jul 14 20:29:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5d33e61c-002a-4aec-bc8a-3fc9c8c554c9 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-2a934128-4c86-4b41-9bb3-5f66029efc67-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-a354c91d-3c3b-433e-8ffa-82faedd1acc1-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-a354c91d-3c3b-433e-8ffa-82faedd1acc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-a354c91d-3c3b-433e-8ffa-82faedd1acc1" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-a354c91d-3c3b-433e-8ffa-82faedd1acc1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Deleting offline snapshot a354c91d-3c3b-433e-8ffa-82faedd1acc1 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] snapshot_file for this snap is: volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd291c0-a926-4484-8bae-8e7cb6c4125a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:02 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:29:02 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:02 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[526f993a-60ae-4a90-9031-88a31f420320]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:02 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:29:02 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:03 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:03 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:29:03 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:03 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:03 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (09c6b27f-78c0-476a-8840-801b268a902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f2e95-33bb-45c7-a7e8-335d9484d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f2e95-33bb-45c7-a7e8-335d9484d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a2dc16-9c64-4307-854c-11da4b819a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:03Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf99c89-46ea-4464-8c85-8b387a7215f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf99c89-46ea-4464-8c85-8b387a7215f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954acc06-ccb1-4686-b5e9-c8f925b7ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954acc06-ccb1-4686-b5e9-c8f925b7ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a2dc16-9c64-4307-854c-11da4b819a78', 'volume_name': 'volume-a5a2dc16-9c64-4307-854c-11da4b819a78', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d554555-8869-43ee-a731-f4cc30b36512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d554555-8869-43ee-a731-f4cc30b36512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa01d79a-c9ff-4660-8794-27037918da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Volume a5a2dc16-9c64-4307-854c-11da4b819a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a2dc16-9c64-4307-854c-11da4b819a78', 'volume_size': 1} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a2dc16-9c64-4307-854c-11da4b819a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:03Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Creating volume a5a2dc16-9c64-4307-854c-11da4b819a78 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:03 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 1073741824 Jul 14 20:29:03 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:03 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.509s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:03 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.312s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:29:03 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1 Jul 14 20:29:03 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:03 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.a354c91d-3c3b-433e-8ffa-82faedd1acc1" returned: 0 in 0.279s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-a354c91d-3c3b-433e-8ffa-82faedd1acc1" released by "_delete_snapshot" :: held 1.646s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" released by "delete_snapshot" :: held 1.670s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:03 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Created reservations ['3bdab476-7fec-4efd-98da-d0a0c098254c', 'fed3c40d-ee75-47b7-8771-1e65da82dbe5', '252bfae4-7b55-4e3b-97af-a3a253be0a8c', '86599796-3e49-49da-a1f1-fa4f901d27c4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:04 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 1073741824" returned: 0 in 0.529s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Delete snapshot completed successfully. Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-35a8f6b9-ccd2-433f-969f-8515185e4590 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-a354c91d-3c3b-433e-8ffa-82faedd1acc1-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:04 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 Jul 14 20:29:04 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:04 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa01d79a-c9ff-4660-8794-27037918da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a2dc16-9c64-4307-854c-11da4b819a78', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7066f3-22c3-43f4-a2e7-b2985fc599a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Volume volume-a5a2dc16-9c64-4307-854c-11da4b819a78 (a5a2dc16-9c64-4307-854c-11da4b819a78): created successfully Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7066f3-22c3-43f4-a2e7-b2985fc599a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (09c6b27f-78c0-476a-8840-801b268a902e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9b56535b-b13f-4554-b639-f0766b69cfe6 tempest-ProjectReaderTests-2118641107 None] Created volume successfully. Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-5854e776-3600-4fd7-864a-e54c67cb5e57-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-5854e776-3600-4fd7-864a-e54c67cb5e57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-5854e776-3600-4fd7-864a-e54c67cb5e57" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-5854e776-3600-4fd7-864a-e54c67cb5e57" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Deleting offline snapshot 5854e776-3600-4fd7-864a-e54c67cb5e57 of volume 0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] snapshot_file for this snap is: volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7ee812-3f5c-4305-a131-c01f0c74d330]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:04 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:29:04 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:04 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3e88fc-d600-4652-aa13-c186c36976da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8911f-06b3-47d8-ad13-632e73ad1fbe]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:05 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da Jul 14 20:29:05 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:05 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da" returned: 0 in 0.402s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:05 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:29:05 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-a5a2dc16-9c64-4307-854c-11da4b819a78-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "cinder-a5a2dc16-9c64-4307-854c-11da4b819a78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=237,cinder:SELECT=181,cinder:INSERT=57,cinder:DELETE=20 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-quobyte-a5a2dc16-9c64-4307-854c-11da4b819a78" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:05 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.417s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-a5a2dc16-9c64-4307-854c-11da4b819a78" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:05 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57 Jul 14 20:29:05 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1796bb9-2be9-425f-9d31-c1921802e1dd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:05 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 Jul 14 20:29:05 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:06 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da.5854e776-3600-4fd7-864a-e54c67cb5e57" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-5854e776-3600-4fd7-864a-e54c67cb5e57" released by "_delete_snapshot" :: held 1.639s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" released by "delete_snapshot" :: held 1.665s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Created reservations ['b782ff3d-58b2-4a83-b384-9998ef37d654', '2a8d3549-d6f0-4857-93cb-2fdd4e3e1d5b', 'a57f03e3-c693-4c07-bf33-996a64209c27', '697788fb-2b13-4bb3-88af-593adbf67396'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:06 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78" returned: 0 in 0.417s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:06 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78 Jul 14 20:29:06 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Delete snapshot completed successfully. Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fab412c4-ddd5-4a98-b16f-3420362c9b60 tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-5854e776-3600-4fd7-864a-e54c67cb5e57-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:06 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a5a2dc16-9c64-4307-854c-11da4b819a78" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-a5a2dc16-9c64-4307-854c-11da4b819a78" released by "delete_volume" :: held 0.728s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Created reservations ['882a0dfe-e287-4279-bbd6-6d46c224b62e', '663562fe-ae05-414a-8a54-23f3fa0a1a2a', 'c216a92c-726d-4061-bda1-c5d90ae4e7ff', 'cdc78952-7576-446e-b95f-19c29570d875'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-0a3e88fc-d600-4652-aa13-c186c36976da-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:06 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:06 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-0a3e88fc-d600-4652-aa13-c186c36976da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b20bf0-6a38-411d-a87c-be137a3c7fec]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:06 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da Jul 14 20:29:06 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:06 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.299s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:06 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Deleted volume successfully. Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-93240d62-d48b-41b8-9458-76a1f5fb5b8c tempest-ProjectReaderTests-2118641107 None] Lock "cinder-a5a2dc16-9c64-4307-854c-11da4b819a78-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:07 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:07 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da Jul 14 20:29:07 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (0133c09f-cace-4ae0-b541-c5fdba74a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a59237-96ef-484c-a75b-31fbe254c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a59237-96ef-484c-a75b-31fbe254c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651666033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233e0cb8-59b0-4b9b-bca9-43d64556f748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:07Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f8e816-7b65-46c4-ae4b-563666f642d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f8e816-7b65-46c4-ae4b-563666f642d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5863cbd8-3dbc-4214-8d08-1760a3446dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5863cbd8-3dbc-4214-8d08-1760a3446dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233e0cb8-59b0-4b9b-bca9-43d64556f748', 'volume_name': 'volume-233e0cb8-59b0-4b9b-bca9-43d64556f748', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d2d257-82f6-4941-8667-b49c38d0de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d2d257-82f6-4941-8667-b49c38d0de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b4de0-a963-4912-99c5-578f5393b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:07 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Volume 233e0cb8-59b0-4b9b-bca9-43d64556f748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233e0cb8-59b0-4b9b-bca9-43d64556f748', 'volume_size': 1} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651666033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233e0cb8-59b0-4b9b-bca9-43d64556f748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:07Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Creating volume 233e0cb8-59b0-4b9b-bca9-43d64556f748 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:07 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:07 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:07 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 1073741824 Jul 14 20:29:07 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0a3e88fc-d600-4652-aa13-c186c36976da" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-quobyte-0a3e88fc-d600-4652-aa13-c186c36976da" released by "delete_volume" :: held 0.722s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Created reservations ['1cd0bf91-1221-4005-9dc3-19feebb9a64f', 'fc87b7a9-8f6a-4338-a436-626161c7a305', '2fa8ba1d-bd5d-4221-9abb-76be0aa830ff', '84aebae4-7396-43b9-b0d7-bc92f6d8c806'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:07 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:07 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:07 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.290s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:07 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Deleted volume successfully. Jul 14 20:29:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b51a1ca7-4456-464f-b1b6-91a60ed790de tempest-VolumesSnapshotListTestJSON-111327246 None] Lock "cinder-0a3e88fc-d600-4652-aa13-c186c36976da-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:08 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 1073741824" returned: 0 in 0.562s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:08 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 Jul 14 20:29:08 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:08 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748" returned: 0 in 0.303s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b4de0-a963-4912-99c5-578f5393b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233e0cb8-59b0-4b9b-bca9-43d64556f748', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e97d4f2-919e-498a-90ac-8a36224639a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Volume volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 (233e0cb8-59b0-4b9b-bca9-43d64556f748): created successfully Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e97d4f2-919e-498a-90ac-8a36224639a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (0133c09f-cace-4ae0-b541-c5fdba74a680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2d7290e7-7fe9-42de-98ba-0042ceb61096 tempest-ProjectReaderTests-2118641107 None] Created volume successfully. Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f3a6e-d780-4f69-8ea9-923784c4724d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:08 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e Jul 14 20:29:08 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:09 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.432s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18626cc8-5701-4acd-af02-e5f226ddaa90', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:29:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-e57d9b67-7d7a-42af-9e9d-140ad2285fa3 req-5e2cc358-a25f-4e7f-bd11-ad3f8d066d32 tempest-TestStampPattern-1766617191 None] attachment_update completed successfully. Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-233e0cb8-59b0-4b9b-bca9-43d64556f748-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-233e0cb8-59b0-4b9b-bca9-43d64556f748-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-quobyte-233e0cb8-59b0-4b9b-bca9-43d64556f748" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-233e0cb8-59b0-4b9b-bca9-43d64556f748" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[250241ad-21d9-454b-a214-eb1dbaeb79a8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:09 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 Jul 14 20:29:09 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:10 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748" returned: 0 in 0.453s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:10 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748 Jul 14 20:29:10 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:10 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-233e0cb8-59b0-4b9b-bca9-43d64556f748" returned: 0 in 0.287s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-233e0cb8-59b0-4b9b-bca9-43d64556f748" released by "delete_volume" :: held 0.787s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Created reservations ['895ee2dd-5815-499e-8075-bbd7e2323b82', '2e323f10-2b21-4732-bf5b-1b8144a39ceb', '0e7405af-d9cf-4634-8e4b-ac3a15e3add7', '2d9d09e4-d45f-451f-8328-6537648ba46a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:10 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:10 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:10 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Deleted volume successfully. Jul 14 20:29:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c68e35fb-040f-4bac-89af-a547b7a0b572 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-233e0cb8-59b0-4b9b-bca9-43d64556f748-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (af5e52a5-6802-46f7-a0ec-093f0120af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab23a6ea-1077-4046-8f19-2890aff4f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab23a6ea-1077-4046-8f19-2890aff4f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376564855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c1aae2-0993-4c7b-97e1-ce814a59ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:11Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d178bb7e-25dc-4ffc-8ca5-2b00fbef1501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d178bb7e-25dc-4ffc-8ca5-2b00fbef1501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f087ca7-ccd1-40f3-bb61-68786e2a5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f087ca7-ccd1-40f3-bb61-68786e2a5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c1aae2-0993-4c7b-97e1-ce814a59ec95', 'volume_name': 'volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a8a57-455a-4e69-993e-4f72a5ec91c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a8a57-455a-4e69-993e-4f72a5ec91c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b541e01d-d3c1-49bf-98f6-834ba8c1ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:11 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Volume 88c1aae2-0993-4c7b-97e1-ce814a59ec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95', 'volume_size': 1} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376564855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c1aae2-0993-4c7b-97e1-ce814a59ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:11Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Creating volume 88c1aae2-0993-4c7b-97e1-ce814a59ec95 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:11 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:29:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:11 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 1073741824 Jul 14 20:29:11 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:12 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 1073741824" returned: 0 in 0.615s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:12 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 Jul 14 20:29:12 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:12 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95" returned: 0 in 0.312s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-af897c4e-015e-478e-a015-d2ab0839215d req-684314a6-7705-4e02-856a-9100b30c0e0e tempest-TestStampPattern-1766617191 None] Terminate volume connection completed successfully. Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-af897c4e-015e-478e-a015-d2ab0839215d req-684314a6-7705-4e02-856a-9100b30c0e0e tempest-TestStampPattern-1766617191 None] Deleting attachment 18626cc8-5701-4acd-af02-e5f226ddaa90. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b541e01d-d3c1-49bf-98f6-834ba8c1ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c8c1f4-22b8-42ba-94f4-ebe68dedde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:12 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Volume volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 (88c1aae2-0993-4c7b-97e1-ce814a59ec95): created successfully Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c8c1f4-22b8-42ba-94f4-ebe68dedde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:12 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (af5e52a5-6802-46f7-a0ec-093f0120af45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2819f9a8-cbb5-4057-b390-5f8ce46f7114 tempest-ProjectReaderTests-2118641107 None] Created volume successfully. Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-88c1aae2-0993-4c7b-97e1-ce814a59ec95-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "cinder-88c1aae2-0993-4c7b-97e1-ce814a59ec95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-quobyte-88c1aae2-0993-4c7b-97e1-ce814a59ec95" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-88c1aae2-0993-4c7b-97e1-ce814a59ec95" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[44edb862-c27f-449c-947a-e553e604f3a3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:13 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 Jul 14 20:29:13 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:14 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95" returned: 0 in 0.523s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:14 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95 Jul 14 20:29:14 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:14 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-88c1aae2-0993-4c7b-97e1-ce814a59ec95" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-88c1aae2-0993-4c7b-97e1-ce814a59ec95" released by "delete_volume" :: held 0.945s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Created reservations ['2c159c50-62c1-4459-91d4-d9ed3c9e399e', '03078676-4104-4417-86c9-1bbddba176a0', '82b41c0a-297e-4367-8364-32063d636b3e', '9069f64b-8e6e-48cd-84b3-bd370ce57285'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:14 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:14 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:15 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Deleted volume successfully. Jul 14 20:29:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4901bee2-1a3a-4469-9306-cc2fafae000d tempest-ProjectReaderTests-2118641107 None] Lock "cinder-88c1aae2-0993-4c7b-97e1-ce814a59ec95-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (23b12909-fa01-417c-b774-e10ce6b01a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25b5ba0-f0c1-4bc1-9185-504311fc0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25b5ba0-f0c1-4bc1-9185-504311fc0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1927493901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d96733-6bb1-4fe1-b454-7a6aa1cf0841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:17Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0999504d-8b8a-4285-a069-1acdcc65a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0999504d-8b8a-4285-a069-1acdcc65a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ac15f9-819d-4dae-9d96-ad22b571cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ac15f9-819d-4dae-9d96-ad22b571cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d96733-6bb1-4fe1-b454-7a6aa1cf0841', 'volume_name': 'volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cb08ba-17d5-4aac-bb05-423e7ad87e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cb08ba-17d5-4aac-bb05-423e7ad87e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2d43d9-59e4-4b36-8260-8d063d4f59f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:16 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Volume 63d96733-6bb1-4fe1-b454-7a6aa1cf0841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841', 'volume_size': 1} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1927493901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d96733-6bb1-4fe1-b454-7a6aa1cf0841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1313d1ffbae54fb5964b02a73510a07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:17Z,use_quota=True,user_id='1a30e016852c428ba485a9cb98583d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Creating volume 63d96733-6bb1-4fe1-b454-7a6aa1cf0841 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:16 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:29:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:16 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 1073741824 Jul 14 20:29:16 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:17 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 1073741824" returned: 0 in 0.541s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:17 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 Jul 14 20:29:17 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:17 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2d43d9-59e4-4b36-8260-8d063d4f59f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7494471f-324c-4b4d-9b05-cf06dfb9a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:17 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Volume volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 (63d96733-6bb1-4fe1-b454-7a6aa1cf0841): created successfully Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7494471f-324c-4b4d-9b05-cf06dfb9a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Flow 'volume_create_manager' (23b12909-fa01-417c-b774-e10ce6b01a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b98a0651-22db-4d5b-8bfc-d0b0f5662b50 tempest-ProjectReaderTests-2118641107 None] Created volume successfully. Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-0cf58ecf-a8a0-437b-85a8-6194ecf4800e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "cinder-0cf58ecf-a8a0-437b-85a8-6194ecf4800e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e9c60a-9150-406f-a0d4-5f08cd41661a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:18 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e Jul 14 20:29:18 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:18 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" returned: 0 in 0.390s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:18 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e Jul 14 20:29:18 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:18 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" returned: 0 in 0.279s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-0cf58ecf-a8a0-437b-85a8-6194ecf4800e" released by "delete_volume" :: held 0.742s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:18 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Created reservations ['f1c16e56-9329-4ccd-afc5-365506fbd5dd', 'bc10f872-346a-49ee-9469-a97919056661', '11bc027a-a816-4ce3-b781-588f179ea69b', 'd6337630-df1d-42c1-85ac-90484060777c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-63d96733-6bb1-4fe1-b454-7a6aa1cf0841-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-63d96733-6bb1-4fe1-b454-7a6aa1cf0841-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:19 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:19 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "cinder-quobyte-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[121fc4f9-e42f-46de-82ad-6a65b54f4c5c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:19 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:19 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Deleted volume successfully. Jul 14 20:29:20 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 Jul 14 20:29:20 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f8885f2a-83df-477d-9a1f-1595fc7ee455 tempest-TestStampPattern-1766617191 None] Lock "cinder-0cf58ecf-a8a0-437b-85a8-6194ecf4800e-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:20 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" returned: 0 in 0.459s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:20 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841 Jul 14 20:29:20 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:20 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-quobyte-63d96733-6bb1-4fe1-b454-7a6aa1cf0841" released by "delete_volume" :: held 0.773s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Created reservations ['ee396da7-3e95-4b12-9f92-fe188e78a188', '7ac8cbba-d764-4e20-ac6a-342ae3a3dd64', 'a40da56d-a05c-49ad-a975-bf74bd448114', 'b0eb4156-c4b1-4253-9c3e-3ab66cd4f1df'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-827f784e-cab4-4e66-948e-1fe1151cb450-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-827f784e-cab4-4e66-948e-1fe1151cb450-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Deleting offline snapshot 827f784e-cab4-4e66-948e-1fe1151cb450 of volume 4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] snapshot_file for this snap is: volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf4e26f-ec6f-4a9c-9c25-eba4a2d7853e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:21 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:29:21 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:21 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:21 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:21 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.267s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Deleted volume successfully. Jul 14 20:29:21 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.373s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[39510c68-8fa7-41e4-873d-88bd5e77521d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:21 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:29:21 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:22 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:22 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:29:22 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:22 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.346s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:22 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450 Jul 14 20:29:22 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:22 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46.827f784e-cab4-4e66-948e-1fe1151cb450" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c00a3d84-3ed6-40fd-99d2-6c6cd92a0104 tempest-ProjectReaderTests-2118641107 None] Lock "cinder-63d96733-6bb1-4fe1-b454-7a6aa1cf0841-delete_volume" released by "delete_volume" :: held 4.827s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-827f784e-cab4-4e66-948e-1fe1151cb450" released by "_delete_snapshot" :: held 3.059s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" released by "delete_snapshot" :: held 3.085s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:24 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Created reservations ['f4b494a3-6aa9-4d77-a02e-8ee0b239909d', '9e41be1a-2f01-493e-a84c-cd0f9f2e6633', '327383a4-538d-4d1b-9f95-a0460f39ca10', '8ec65679-47ba-4360-904c-769fab75fc57'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Delete snapshot completed successfully. Jul 14 20:29:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-382a73f0-bec4-4692-9fb6-470cd9d2af71 tempest-TestStampPattern-1766617191 None] Lock "cinder-827f784e-cab4-4e66-948e-1fe1151cb450-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "cinder-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Acquiring lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec959668-1506-4a29-9e5d-e24a09298ed3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:29 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:29:29 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:30 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:30 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46 Jul 14 20:29:30 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:30 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "cinder-quobyte-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46" released by "delete_volume" :: held 0.725s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Created reservations ['0a424b2b-9123-4e4d-b99f-2746fff6e856', 'b9212755-8bcd-4590-8c74-782e7ba62a6c', 'e58ead32-3aa1-4a58-a948-10459522e2a6', 'dc04c606-c738-4f7e-8ca4-347a1241b5a4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:30 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:29:30 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:30 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:29:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Deleted volume successfully. Jul 14 20:29:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-fd4f68bf-5d90-453d-a637-f7c19c8f5ff4 tempest-TestStampPattern-1766617191 None] Lock "cinder-4bf49fe6-8315-4ad1-85b9-398e4b4cfa46-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:40 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:INSERT=38,cinder:UPDATE=139,cinder:SELECT=96,cinder:DELETE=13 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:29:40 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=74,cinder:DELETE=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Flow 'volume_create_manager' (c5d83cef-b2d7-427f-bd81-049f3944e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314c7a1-ecfc-4c3d-b285-674cfe772596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314c7a1-ecfc-4c3d-b285-674cfe772596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1443235439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4125d8-95d0-40c3-aefb-09ba63ec1ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96503b73e2fd46d8a34c914b894d8f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:45Z,use_quota=True,user_id='30dab0a098284728ab89fbf0bd2a4337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e425eb-7114-4f78-afda-9e089d88e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e425eb-7114-4f78-afda-9e089d88e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f5d810-fe73-46a4-b569-ec82af6d1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f5d810-fe73-46a4-b569-ec82af6d1a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4125d8-95d0-40c3-aefb-09ba63ec1ed2', 'volume_name': 'volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb14f6-28be-4b12-96dc-0c0dd7150719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb14f6-28be-4b12-96dc-0c0dd7150719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb712ff7-0b9a-4385-a209-dd07d8131415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Volume dd4125d8-95d0-40c3-aefb-09ba63ec1ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2', 'volume_size': 1} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1443235439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4125d8-95d0-40c3-aefb-09ba63ec1ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96503b73e2fd46d8a34c914b894d8f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:45Z,use_quota=True,user_id='30dab0a098284728ab89fbf0bd2a4337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Creating volume dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:45 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:45 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 1073741824 Jul 14 20:29:45 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:45 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 1073741824" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:45 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:29:45 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:46 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb712ff7-0b9a-4385-a209-dd07d8131415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e7120e-0a23-4c65-89f3-6f0c5763ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Volume volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 (dd4125d8-95d0-40c3-aefb-09ba63ec1ed2): created successfully Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e7120e-0a23-4c65-89f3-6f0c5763ff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Flow 'volume_create_manager' (c5d83cef-b2d7-427f-bd81-049f3944e082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:46 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e0d896f1-6bc0-428c-a026-dabbb8b97e21 tempest-VolumeDependencyTests-645491068 None] Created volume successfully. Jul 14 20:29:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Creating offline snapshot 707d6c02-049d-4171-b057-ba95103b6bf7 of volume dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:29:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8faf4-c09e-4c9d-b959-6b472baa698e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:47 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:29:47 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:48 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:48 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 1G Jul 14 20:29:48 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:48 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 1G" returned: 0 in 0.435s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:48 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:48 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:48 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:48 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 is being set with open permissions: ugo+rw Jul 14 20:29:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:48 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:48 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:49 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.252s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:49 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info Jul 14 20:29:49 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:49 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info" returned: 0 in 0.245s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:49 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info is being set with open permissions: ugo+rw Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:49 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info Jul 14 20:29:49 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:49 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.info" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cecf7187-e23b-4f6a-b333-40dee9516d07 tempest-VolumeDependencyTests-645491068 None] Create snapshot completed successfully Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Flow 'volume_create_manager' (02b6a2c7-7bd5-4dc9-8616-b0092a7e9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0feb1438-7576-435b-8db9-9e197de04531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0feb1438-7576-435b-8db9-9e197de04531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1470862607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91169662-16d3-4328-b164-0de37b94f89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96503b73e2fd46d8a34c914b894d8f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=707d6c02-049d-4171-b057-ba95103b6bf7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:29:51Z,use_quota=True,user_id='30dab0a098284728ab89fbf0bd2a4337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9e85be-96e4-4a3b-a907-5a554f72bca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9e85be-96e4-4a3b-a907-5a554f72bca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff8903c-1c5d-4de5-bbac-6d812d3ea3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff8903c-1c5d-4de5-bbac-6d812d3ea3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91169662-16d3-4328-b164-0de37b94f89c', 'volume_name': 'volume-91169662-16d3-4328-b164-0de37b94f89c', 'volume_size': 1, 'snapshot_id': '707d6c02-049d-4171-b057-ba95103b6bf7'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08165a15-1b75-44ec-bca8-c4a088d0f079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08165a15-1b75-44ec-bca8-c4a088d0f079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3440073-f91f-4c99-bb77-4c9a6d1e16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Volume 91169662-16d3-4328-b164-0de37b94f89c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91169662-16d3-4328-b164-0de37b94f89c', 'volume_size': 1, 'snapshot_id': '707d6c02-049d-4171-b057-ba95103b6bf7'} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7-91169662-16d3-4328-b164-0de37b94f89c" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7-91169662-16d3-4328-b164-0de37b94f89c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Creating volume 91169662-16d3-4328-b164-0de37b94f89c from snapshot 707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] snapshot: 707d6c02-049d-4171-b057-ba95103b6bf7, volume: 91169662-16d3-4328-b164-0de37b94f89c, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[71323754-4a08-4a96-9fc4-9a3eb782bf02]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:51 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:51 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:52 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8776ba42-4194-4eae-92d2-12a36eca72b6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:52 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:29:52 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:52 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:29:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:52 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c Jul 14 20:29:52 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:56 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c" returned: 0 in 4.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9795dcf0-a510-48c1-af90-69dd1f19f8c3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:56 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:29:56 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:57 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.552s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:29:57 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Converted 1024.00 MB image at 233.38 MB/s Jul 14 20:29:57 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c is being set with open permissions: ugo+rw Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:57 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c Jul 14 20:29:57 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:57 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c" returned: 0 in 0.232s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" released by "_copy_volume_from_snapshot" :: held 6.060s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7-91169662-16d3-4328-b164-0de37b94f89c" released by "_create_volume_from_snapshot" :: held 6.094s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.112s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3440073-f91f-4c99-bb77-4c9a6d1e16dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91169662-16d3-4328-b164-0de37b94f89c', 'volume_size': 1, 'snapshot_id': '707d6c02-049d-4171-b057-ba95103b6bf7'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf962241-780a-4d73-a64c-0944f89642cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:29:57 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Volume volume-91169662-16d3-4328-b164-0de37b94f89c (91169662-16d3-4328-b164-0de37b94f89c): created successfully Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf962241-780a-4d73-a64c-0944f89642cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:29:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Flow 'volume_create_manager' (02b6a2c7-7bd5-4dc9-8616-b0092a7e9b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:29:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-25f6f1f5-6997-4e66-9681-2ec07d9ebe2f tempest-VolumeDependencyTests-645491068 None] Created volume successfully. Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-707d6c02-049d-4171-b057-ba95103b6bf7-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-707d6c02-049d-4171-b057-ba95103b6bf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Deleting offline snapshot 707d6c02-049d-4171-b057-ba95103b6bf7 of volume dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] snapshot_file for this snap is: volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f341f9-14b0-4cd7-afad-01bd8cd79f54]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:58 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:58 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:58 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a95e1-3132-4565-acea-62bf5629d342]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:58 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:29:58 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:58 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:58 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:58 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:59 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:29:59 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7 Jul 14 20:29:59 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:29:59 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2.707d6c02-049d-4171-b057-ba95103b6bf7" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-707d6c02-049d-4171-b057-ba95103b6bf7" released by "_delete_snapshot" :: held 1.431s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" released by "delete_snapshot" :: held 1.456s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Created reservations ['c5446006-f740-4e4b-b766-3892609e8a5c', 'caa0e85b-fc89-4eb6-ace6-322532c2a9ea', 'd7bda0bd-2285-4af6-a000-c3ca52bd45e3', '5f9ca444-3ebc-4838-8171-5733228c8b22'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:29:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Delete snapshot completed successfully. Jul 14 20:29:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-546e36fe-5b53-442b-a544-179238b10df1 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-707d6c02-049d-4171-b057-ba95103b6bf7-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[48169c31-c0ea-4438-b76c-eb2a7937bc77]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:00 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:30:00 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:00 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.338s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:00 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2 Jul 14 20:30:00 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:00 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2" released by "delete_volume" :: held 0.637s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Created reservations ['c1fdee89-9221-4e87-9494-0da35438aec7', '4b24453b-c010-41dc-97dd-2f40ba219646', 'c9aa8cd6-5997-4519-a4d7-348772b42db3', '1a2f0a41-2d19-4fa3-aaef-900307c10059'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:01 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:01 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:01 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.237s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Deleted volume successfully. Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e5b608e-4cf0-4a69-8d51-fcb0d92282e7 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-dd4125d8-95d0-40c3-aefb-09ba63ec1ed2-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-91169662-16d3-4328-b164-0de37b94f89c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-91169662-16d3-4328-b164-0de37b94f89c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513c724-e07d-47da-9fbb-3edaa22047d4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:01 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c Jul 14 20:30:01 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:01 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:01 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c Jul 14 20:30:01 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:02 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-91169662-16d3-4328-b164-0de37b94f89c" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-quobyte-91169662-16d3-4328-b164-0de37b94f89c" released by "delete_volume" :: held 0.634s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Created reservations ['056a6d7d-2613-4506-85c8-edab678c1090', '9766f105-3062-4111-8a8c-acfda3130b35', '8f2dffcc-c009-4363-a649-8a499a93933a', '700b61e3-db6c-4749-8903-39847e0f2777'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:02 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:02 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:02 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.237s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:02 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Deleted volume successfully. Jul 14 20:30:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a002c61e-ef75-4c59-8d77-d06e0b787aa3 tempest-VolumeDependencyTests-645491068 None] Lock "cinder-91169662-16d3-4328-b164-0de37b94f89c-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:03 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:03 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:03 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:30:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Flow 'volume_create_manager' (413157e0-1700-417d-937d-cb013f29695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f51b205-2901-414d-ae3a-f44d39122b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f51b205-2901-414d-ae3a-f44d39122b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab5a3a-435e-4f15-b89a-e79673f85051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01164bf6848e46b5898afa634e39bfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:08Z,use_quota=True,user_id='2cf9ee2f5ab94c9f911b76c6c04b65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46c8863-47a5-425e-b203-6bc1c9754f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46c8863-47a5-425e-b203-6bc1c9754f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a38e25-3016-4dd8-a7b2-9abcb58f8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:07 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a38e25-3016-4dd8-a7b2-9abcb58f8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcab5a3a-435e-4f15-b89a-e79673f85051', 'volume_name': 'volume-bcab5a3a-435e-4f15-b89a-e79673f85051', 'volume_size': 1, 'image_id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2874a18dbcd1e525e44c598fc8a1d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01164bf6848e46b5898afa634e39bfbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15601561238fe777376aaf2bcd2576f6c68cbf477f5d89314462536e53a29664ea71528e4dd1c1d17f1b7fc298b92636438c21966d1649e8d8790fc2411fd33f', 'id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'created_at': datetime.datetime(2026, 7, 14, 18, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eeb2d6-70fd-4005-9fde-7acf3c1ebf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eeb2d6-70fd-4005-9fde-7acf3c1ebf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9338e434-d7bf-4bc5-ae5c-b262d93e2c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Volume bcab5a3a-435e-4f15-b89a-e79673f85051: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcab5a3a-435e-4f15-b89a-e79673f85051', 'volume_size': 1, 'image_id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2874a18dbcd1e525e44c598fc8a1d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01164bf6848e46b5898afa634e39bfbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15601561238fe777376aaf2bcd2576f6c68cbf477f5d89314462536e53a29664ea71528e4dd1c1d17f1b7fc298b92636438c21966d1649e8d8790fc2411fd33f', 'id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'created_at': datetime.datetime(2026, 7, 14, 18, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3/file', 'properties': {}}, 'image_service': } Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Trying to clone bcab5a3a-435e-4f15-b89a-e79673f85051 from image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:30:08 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Image download 0.00 MB at 0.00 MB/s Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11791ed-11c8-4cf6-add2-12fcb0820b69]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:08 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:08 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:08 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:08 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:08 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Flow 'volume_create_manager' (4d71ef65-4067-42e5-8872-99f084f2af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120913f-6e65-4e77-9acd-de27dcbceb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120913f-6e65-4e77-9acd-de27dcbceb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1007560769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3716fbb5-6210-473b-83b5-2447a3cb1551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bef246c9e9646cba68ca205a760d338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:09Z,use_quota=True,user_id='1ee862990e8f4675b05e8d51b856c3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66d1f5c-6287-41f4-af41-b516fe177a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66d1f5c-6287-41f4-af41-b516fe177a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea2270-4c80-47e4-8e64-bdace6e3e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea2270-4c80-47e4-8e64-bdace6e3e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3716fbb5-6210-473b-83b5-2447a3cb1551', 'volume_name': 'volume-3716fbb5-6210-473b-83b5-2447a3cb1551', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77205fe-69f6-436c-beff-8bcbbe510762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77205fe-69f6-436c-beff-8bcbbe510762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf4a02-a10d-42a6-9965-13452efa6788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Volume 3716fbb5-6210-473b-83b5-2447a3cb1551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3716fbb5-6210-473b-83b5-2447a3cb1551', 'volume_size': 1} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1007560769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3716fbb5-6210-473b-83b5-2447a3cb1551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bef246c9e9646cba68ca205a760d338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:09Z,use_quota=True,user_id='1ee862990e8f4675b05e8d51b856c3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Creating volume 3716fbb5-6210-473b-83b5-2447a3cb1551 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:08 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:08 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 1073741824 Jul 14 20:30:08 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:08 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Temporary image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 is fetched for user 2cf9ee2f5ab94c9f911b76c6c04b65a6. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4e226-ceda-4f57-bc2f-5f51a33acbdb]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:09 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:09 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:09 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 1073741824" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:09 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:09 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 Jul 14 20:30:09 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:09 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:09 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:09 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf4a02-a10d-42a6-9965-13452efa6788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3716fbb5-6210-473b-83b5-2447a3cb1551', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4250a4-c32c-46cf-b7f8-411c820107f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:09 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Volume volume-3716fbb5-6210-473b-83b5-2447a3cb1551 (3716fbb5-6210-473b-83b5-2447a3cb1551): created successfully Jul 14 20:30:09 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4250a4-c32c-46cf-b7f8-411c820107f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Flow 'volume_create_manager' (4d71ef65-4067-42e5-8872-99f084f2af2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab5a3a-435e-4f15-b89a-e79673f85051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01164bf6848e46b5898afa634e39bfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:08Z,use_quota=True,user_id='2cf9ee2f5ab94c9f911b76c6c04b65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Creating volume bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:09 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4776c54a-f03d-45aa-bf49-a06c7d9a97ff tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Created volume successfully. Jul 14 20:30:09 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1073741824 Jul 14 20:30:09 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:09 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1073741824" returned: 0 in 0.430s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:10 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:10 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:10 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Attempting download of 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}])) to volume bcab5a3a-435e-4f15-b89a-e79673f85051. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4457ef-4f9f-41a8-97f8-66ec3e7b86b2]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[24568b76-91e1-40fb-aed5-803c5a01e452]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:10 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo Jul 14 20:30:10 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:10 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 Jul 14 20:30:10 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:10 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:10 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551" returned: 0 in 0.339s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.361s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-3716fbb5-6210-473b-83b5-2447a3cb1551', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce51e60d-d589-4da4-a269-0c407fe70c64', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:30:10 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo Jul 14 20:30:10 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:10 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-bee4ddd6-f41c-40e6-ab0c-75f9c5b915eb req-df4c626d-538b-4db7-afcb-eb77262a78a0 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] attachment_update completed successfully. Jul 14 20:30:11 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo" returned: 1 in 0.330s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_pkc91sbo' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2176c160-c235-4035-8f02-90a0b2a12fa3]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:11 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:11 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:11 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:11 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD Jul 14 20:30:11 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:11 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 was raw, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:30:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:11 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:11 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:12 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0f4f0421-bb58-4c6d-a525-f93dd37de4b3_x1l2ys5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:30:12 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:12 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1G Jul 14 20:30:12 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:12 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 1G" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b83667-8cd1-47a6-942c-bb61d66c32c0]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:12 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:12 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:12 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:12 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:12 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:13 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 1 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Downloaded image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}])) to volume bcab5a3a-435e-4f15-b89a-e79673f85051 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Temporary image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 for user 2cf9ee2f5ab94c9f911b76c6c04b65a6 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Marking volume bcab5a3a-435e-4f15-b89a-e79673f85051 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Copying metadata from image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 to bcab5a3a-435e-4f15-b89a-e79673f85051. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Creating volume glance metadata for volume bcab5a3a-435e-4f15-b89a-e79673f85051 backed by image 0f4f0421-bb58-4c6d-a525-f93dd37de4b3 with: {'image_id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5d2874a18dbcd1e525e44c598fc8a1d4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9338e434-d7bf-4bc5-ae5c-b262d93e2c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcab5a3a-435e-4f15-b89a-e79673f85051', 'volume_size': 1, 'image_id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d2874a18dbcd1e525e44c598fc8a1d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01164bf6848e46b5898afa634e39bfbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15601561238fe777376aaf2bcd2576f6c68cbf477f5d89314462536e53a29664ea71528e4dd1c1d17f1b7fc298b92636438c21966d1649e8d8790fc2411fd33f', 'id': '0f4f0421-bb58-4c6d-a525-f93dd37de4b3', 'created_at': datetime.datetime(2026, 7, 14, 18, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0f4f0421-bb58-4c6d-a525-f93dd37de4b3/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbba4110-10f0-487b-870a-fc29df537046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:13 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Volume volume-bcab5a3a-435e-4f15-b89a-e79673f85051 (bcab5a3a-435e-4f15-b89a-e79673f85051): created successfully Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbba4110-10f0-487b-870a-fc29df537046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Flow 'volume_create_manager' (413157e0-1700-417d-937d-cb013f29695c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-eb44971b-e168-41cb-a1b6-7c05c78b5018 tempest-VolumeImageDependencyTests-620433365 None] Created volume successfully. Jul 14 20:30:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-9eb1065e-b2ad-493e-b459-3a235bad78bd req-97db9612-6ebe-40ec-b79b-775bc69beafa tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Terminate volume connection completed successfully. Jul 14 20:30:13 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-9eb1065e-b2ad-493e-b459-3a235bad78bd req-97db9612-6ebe-40ec-b79b-775bc69beafa tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Deleting attachment ce51e60d-d589-4da4-a269-0c407fe70c64. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Acquiring lock "cinder-bcab5a3a-435e-4f15-b89a-e79673f85051-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "cinder-bcab5a3a-435e-4f15-b89a-e79673f85051-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Acquiring lock "cinder-quobyte-bcab5a3a-435e-4f15-b89a-e79673f85051" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "cinder-quobyte-bcab5a3a-435e-4f15-b89a-e79673f85051" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac673d7c-a3ea-4e48-9bb8-e9ab54a3df23]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:14 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:14 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:14 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 0 in 0.338s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:14 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:14 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "cinder-3716fbb5-6210-473b-83b5-2447a3cb1551-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "cinder-3716fbb5-6210-473b-83b5-2447a3cb1551-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "cinder-quobyte-3716fbb5-6210-473b-83b5-2447a3cb1551" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "cinder-quobyte-3716fbb5-6210-473b-83b5-2447a3cb1551" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c78b95-832e-4875-8f90-bb8895f33e27]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:14 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 1 in 0.366s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:30:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:14 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 Jul 14 20:30:14 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:14 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051 Jul 14 20:30:14 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:15 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-bcab5a3a-435e-4f15-b89a-e79673f85051" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:15 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "cinder-quobyte-bcab5a3a-435e-4f15-b89a-e79673f85051" released by "delete_volume" :: held 1.006s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:15 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551 Jul 14 20:30:15 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Created reservations ['59e187bc-6b96-4a0a-8cd8-474d7ff05c58', 'daaf41a7-f3b3-4897-9216-88be61f8f587', 'ee948ed0-8b3c-40f6-9387-1ffaa3bce504', '644edbc3-cd4a-4af5-bdd0-11e915470c30'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:15 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:15 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:15 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3716fbb5-6210-473b-83b5-2447a3cb1551" returned: 0 in 0.269s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "cinder-quobyte-3716fbb5-6210-473b-83b5-2447a3cb1551" released by "delete_volume" :: held 0.665s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Created reservations ['4e0bde48-b382-45ed-84bc-c28334f686e1', '02c7d459-cded-4ef4-b3fb-0f9c5fe52508', '2eea66df-2d46-4d9e-95cc-fc5fbb041f9c', 'edb129bc-6957-4c43-9f8d-ad84662f0c1c'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:15 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.237s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Deleted volume successfully. Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e87e84ee-1012-4256-b4c1-f107e48e76fe tempest-VolumeImageDependencyTests-620433365 None] Lock "cinder-bcab5a3a-435e-4f15-b89a-e79673f85051-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:15 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:15 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:15 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Deleted volume successfully. Jul 14 20:30:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-58d3e375-1a78-4aeb-838c-410b659a1920 tempest-TestServerVolumeAttachScenarioOldVersion-761405195 None] Lock "cinder-3716fbb5-6210-473b-83b5-2447a3cb1551-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:25 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=56,cinder:SELECT=45,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:30:25 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=54,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:30:40 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Flow 'volume_create_manager' (95c67c38-670f-40a9-aa9b-12254ee12313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b9b643-da3f-4ce3-868b-c9644189d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b9b643-da3f-4ce3-868b-c9644189d857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2097882053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7043d0-a57a-4ee6-86f2-366758a234a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c97c1d99f5a45baa3c54bdd16cffebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:41Z,use_quota=True,user_id='e5d9bd978d4241498aa1ddaff834bd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad52b13-4c07-45c5-86c0-64e547f5a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad52b13-4c07-45c5-86c0-64e547f5a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bc6697-ff79-4c91-82c6-7b093cdfc2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bc6697-ff79-4c91-82c6-7b093cdfc2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7043d0-a57a-4ee6-86f2-366758a234a6', 'volume_name': 'volume-6a7043d0-a57a-4ee6-86f2-366758a234a6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fe63b4-3ac4-4764-97b4-406aec51493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fe63b4-3ac4-4764-97b4-406aec51493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10f4370-290c-4842-88bb-9e4d5c41569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:41 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Volume 6a7043d0-a57a-4ee6-86f2-366758a234a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7043d0-a57a-4ee6-86f2-366758a234a6', 'volume_size': 1} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2097882053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7043d0-a57a-4ee6-86f2-366758a234a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c97c1d99f5a45baa3c54bdd16cffebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:41Z,use_quota=True,user_id='e5d9bd978d4241498aa1ddaff834bd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Creating volume 6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:41 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:41 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 1073741824 Jul 14 20:30:41 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:41 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 1073741824" returned: 0 in 0.457s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:41 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:41 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:41 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.263s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10f4370-290c-4842-88bb-9e4d5c41569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7043d0-a57a-4ee6-86f2-366758a234a6', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb4f5f9-5451-4d5e-a8c5-6dca10251579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:41 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Volume volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 (6a7043d0-a57a-4ee6-86f2-366758a234a6): created successfully Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb4f5f9-5451-4d5e-a8c5-6dca10251579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Flow 'volume_create_manager' (95c67c38-670f-40a9-aa9b-12254ee12313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a40963d4-5898-4ff5-947b-d17a86e5dc62 tempest-SnapshotDependencyTests-259017027 None] Created volume successfully. Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Creating offline snapshot 03504fc5-47ed-43e6-a358-f4d12295491e of volume 6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46d87e-cff0-4e35-9522-8411e8aed4ac]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:43 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:43 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:43 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:43 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e 1G Jul 14 20:30:43 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:44 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e 1G" returned: 0 in 0.456s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:44 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:44 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:44 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:44 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e is being set with open permissions: ugo+rw Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:44 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:44 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:44 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.250s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:44 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info Jul 14 20:30:44 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:45 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:45 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info is being set with open permissions: ugo+rw Jul 14 20:30:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:45 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info Jul 14 20:30:45 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:45 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.info" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-92d8d81f-5f3a-4f38-8ef0-4c1c8e35f53b tempest-SnapshotDependencyTests-259017027 None] Create snapshot completed successfully Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Flow 'volume_create_manager' (867e5f24-25a0-45e4-bc33-ba1958817695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3792636-9448-4751-ac84-50f20d545bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3792636-9448-4751-ac84-50f20d545bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014026ea-ad8d-4995-96d2-1acf58aa671a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c97c1d99f5a45baa3c54bdd16cffebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03504fc5-47ed-43e6-a358-f4d12295491e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:46Z,use_quota=True,user_id='e5d9bd978d4241498aa1ddaff834bd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd602c6-a26b-47ec-a1e2-1d5121001963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd602c6-a26b-47ec-a1e2-1d5121001963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dd06f5-258d-4b02-9eed-c22f0320b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dd06f5-258d-4b02-9eed-c22f0320b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '014026ea-ad8d-4995-96d2-1acf58aa671a', 'volume_name': 'volume-014026ea-ad8d-4995-96d2-1acf58aa671a', 'volume_size': 1, 'snapshot_id': '03504fc5-47ed-43e6-a358-f4d12295491e'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c56fea5-18ef-4103-8e88-dfacccb8e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c56fea5-18ef-4103-8e88-dfacccb8e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e667f32b-8629-4b3a-9779-0a4e038f2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Volume 014026ea-ad8d-4995-96d2-1acf58aa671a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-014026ea-ad8d-4995-96d2-1acf58aa671a', 'volume_size': 1, 'snapshot_id': '03504fc5-47ed-43e6-a358-f4d12295491e'} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e-014026ea-ad8d-4995-96d2-1acf58aa671a" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e-014026ea-ad8d-4995-96d2-1acf58aa671a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Creating volume 014026ea-ad8d-4995-96d2-1acf58aa671a from snapshot 03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] snapshot: 03504fc5-47ed-43e6-a358-f4d12295491e, volume: 014026ea-ad8d-4995-96d2-1acf58aa671a, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbabb26-f9bc-46da-b854-40f8f3c721d2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:46 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:46 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:46 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a7043d0-a57a-4ee6-86f2-366758a234a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd69b79-352d-4fdd-9e8d-5a7e9c244d7d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:46 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:46 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:46 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.380s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:30:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:47 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a Jul 14 20:30:47 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:52 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a" returned: 0 in 5.153s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d20df8-637e-49db-8cd8-e9b087e77169]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:52 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:52 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:52 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.654s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:30:52 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Converted 1024.00 MB image at 198.66 MB/s Jul 14 20:30:52 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a is being set with open permissions: ugo+rw Jul 14 20:30:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:52 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a Jul 14 20:30:52 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:53 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" released by "_copy_volume_from_snapshot" :: held 6.937s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e-014026ea-ad8d-4995-96d2-1acf58aa671a" released by "_create_volume_from_snapshot" :: held 6.975s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.991s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e667f32b-8629-4b3a-9779-0a4e038f2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014026ea-ad8d-4995-96d2-1acf58aa671a', 'volume_size': 1, 'snapshot_id': '03504fc5-47ed-43e6-a358-f4d12295491e'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd6d494-b8c2-4cb9-8531-12c4febb9d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Volume volume-014026ea-ad8d-4995-96d2-1acf58aa671a (014026ea-ad8d-4995-96d2-1acf58aa671a): created successfully Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd6d494-b8c2-4cb9-8531-12c4febb9d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Flow 'volume_create_manager' (867e5f24-25a0-45e4-bc33-ba1958817695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e335ac40-13fb-44e4-b037-ea7e5bae6ba3 tempest-SnapshotDependencyTests-259017027 None] Created volume successfully. Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-03504fc5-47ed-43e6-a358-f4d12295491e-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-03504fc5-47ed-43e6-a358-f4d12295491e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Deleting offline snapshot 03504fc5-47ed-43e6-a358-f4d12295491e of volume 6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] snapshot_file for this snap is: volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b7142-7a1c-4b47-86c5-413bf2dfa6a3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:54 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:54 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:54 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.422s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a7043d0-a57a-4ee6-86f2-366758a234a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a6219-b92b-430c-a91d-c61ea62d7a99]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:54 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:54 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:54 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.441s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:54 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:54 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:55 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.394s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:55 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e Jul 14 20:30:55 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:55 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6.03504fc5-47ed-43e6-a358-f4d12295491e" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-03504fc5-47ed-43e6-a358-f4d12295491e" released by "_delete_snapshot" :: held 1.640s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" released by "delete_snapshot" :: held 1.671s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Created reservations ['215ca6e0-a348-46ff-802b-5b135cc73ef1', '285cdf9e-9462-4692-a375-34d754ab093e', 'e5c01802-f58f-4fd3-b337-120e3acf13d7', 'eeba3057-ff87-47a1-95cb-68a0a321a3ae'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Delete snapshot completed successfully. Jul 14 20:30:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-66608926-16c1-49b8-bba5-a78c7efd903a tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-03504fc5-47ed-43e6-a358-f4d12295491e-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Flow 'volume_create_manager' (6ddec1af-d15b-4d96-a238-e012874b6dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee80c144-6e3a-41d7-b75a-d319eb9c7f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee80c144-6e3a-41d7-b75a-d319eb9c7f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1531976559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ea3c87-a362-4c0a-b301-b5a4a5c85150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2796a967c47848b4ab8712dfb14588f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:56Z,use_quota=True,user_id='2a9d3b44f1d64a90a2aa990c89a77b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683d8be2-9475-41b3-a33e-b0b6bec15125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683d8be2-9475-41b3-a33e-b0b6bec15125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78391998-c933-439f-b1f4-a62d19092b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78391998-c933-439f-b1f4-a62d19092b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ea3c87-a362-4c0a-b301-b5a4a5c85150', 'volume_name': 'volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4b329-9cb4-45d1-85da-4d7e65724591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4b329-9cb4-45d1-85da-4d7e65724591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7df8c9-bed7-49e8-b828-d35ff4f206f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume 67ea3c87-a362-4c0a-b301-b5a4a5c85150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150', 'volume_size': 1} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1531976559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ea3c87-a362-4c0a-b301-b5a4a5c85150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2796a967c47848b4ab8712dfb14588f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:56Z,use_quota=True,user_id='2a9d3b44f1d64a90a2aa990c89a77b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Creating volume 67ea3c87-a362-4c0a-b301-b5a4a5c85150 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:56 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-6a7043d0-a57a-4ee6-86f2-366758a234a6-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:56 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 1073741824 Jul 14 20:30:56 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-6a7043d0-a57a-4ee6-86f2-366758a234a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6661987-745b-4ce7-807b-e6759f5f7255]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:56 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:56 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Flow 'volume_create_manager' (a4b62f06-e912-4444-92e8-999f3b7acc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d7ec1a-cc6b-4d11-85b4-45b87b19279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d7ec1a-cc6b-4d11-85b4-45b87b19279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-535242945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec95bde6-cb16-498f-b54a-b40de3ce4685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2796a967c47848b4ab8712dfb14588f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:56Z,use_quota=True,user_id='2a9d3b44f1d64a90a2aa990c89a77b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85567313-4975-4437-aeee-4e2b5ca30d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85567313-4975-4437-aeee-4e2b5ca30d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353bdcb-79d8-4850-9533-c11069fb5401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4353bdcb-79d8-4850-9533-c11069fb5401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec95bde6-cb16-498f-b54a-b40de3ce4685', 'volume_name': 'volume-ec95bde6-cb16-498f-b54a-b40de3ce4685', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444f6b06-84e8-412e-8ca4-24fb93d62067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444f6b06-84e8-412e-8ca4-24fb93d62067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce54c348-f6ac-4093-b21d-512e7337644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:56 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume ec95bde6-cb16-498f-b54a-b40de3ce4685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec95bde6-cb16-498f-b54a-b40de3ce4685', 'volume_size': 1} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:56 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 1073741824" returned: 0 in 0.634s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:56 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.485s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:56 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6 Jul 14 20:30:56 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:56 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 Jul 14 20:30:56 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:57 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6a7043d0-a57a-4ee6-86f2-366758a234a6" returned: 0 in 0.252s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-6a7043d0-a57a-4ee6-86f2-366758a234a6" released by "delete_volume" :: held 0.830s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:57 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-535242945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec95bde6-cb16-498f-b54a-b40de3ce4685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2796a967c47848b4ab8712dfb14588f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:30:56Z,use_quota=True,user_id='2a9d3b44f1d64a90a2aa990c89a77b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Creating volume ec95bde6-cb16-498f-b54a-b40de3ce4685 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:30:57 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Created reservations ['c107ae80-ce1c-45e1-ab9a-f07007e2d874', '50963cfc-07ba-47ef-8edd-6aa3b7475cc3', 'a3671c44-625f-4b14-ae59-8a3fcf11ba9f', 'd0a85c92-defa-413d-8c4c-fcc50bd950f9'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7df8c9-bed7-49e8-b828-d35ff4f206f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb923b-6500-413a-961e-78e6d508c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:57 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 1073741824 Jul 14 20:30:57 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:57 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 (67ea3c87-a362-4c0a-b301-b5a4a5c85150): created successfully Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb923b-6500-413a-961e-78e6d508c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Flow 'volume_create_manager' (6ddec1af-d15b-4d96-a238-e012874b6dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8ddadc07-bc25-4f86-b6e2-a67c275c9b35 tempest-TestServerVolumeAttachmentScenario-415458385 None] Created volume successfully. Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:57 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:57 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:57 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Deleted volume successfully. Jul 14 20:30:57 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 1073741824" returned: 0 in 0.558s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b2576b00-5ddc-4623-9e6c-24d9bb531182 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-6a7043d0-a57a-4ee6-86f2-366758a234a6-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:57 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 Jul 14 20:30:57 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:58 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce54c348-f6ac-4093-b21d-512e7337644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec95bde6-cb16-498f-b54a-b40de3ce4685', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d4852-5c87-4947-b57a-ff1ef2e6edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:30:58 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Volume volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 (ec95bde6-cb16-498f-b54a-b40de3ce4685): created successfully Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d4852-5c87-4947-b57a-ff1ef2e6edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Flow 'volume_create_manager' (a4b62f06-e912-4444-92e8-999f3b7acc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:30:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3895324d-ea6f-446c-9060-deb581e675c2 tempest-TestServerVolumeAttachmentScenario-415458385 None] Created volume successfully. Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-014026ea-ad8d-4995-96d2-1acf58aa671a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-014026ea-ad8d-4995-96d2-1acf58aa671a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688bd54-b618-44b6-9b2c-5576f20ff6ca]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:58 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a Jul 14 20:30:58 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:58 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a" returned: 0 in 0.380s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:58 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a Jul 14 20:30:58 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:59 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-014026ea-ad8d-4995-96d2-1acf58aa671a" returned: 0 in 0.240s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-quobyte-014026ea-ad8d-4995-96d2-1acf58aa671a" released by "delete_volume" :: held 0.663s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Created reservations ['5c76c229-ed5b-4aee-8f79-f64beb26195a', '3a603614-0027-4402-8b31-cda6ef8d6217', 'd3edb862-d09d-4d1b-9d52-8c83135349be', '431c50da-be6e-46be-bef8-4f6bb7f206d9'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:30:59 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:30:59 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:30:59 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:30:59 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Deleted volume successfully. Jul 14 20:30:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-0ef3b889-f39e-49ef-8463-8e7762781253 tempest-SnapshotDependencyTests-259017027 None] Lock "cinder-014026ea-ad8d-4995-96d2-1acf58aa671a-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:03 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:31:03 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:03 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:31:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:31:09 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=36,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:31:09 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=35,cinder:SELECT=20,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:31:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:31:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:31:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ecb89-d0cf-4eb9-a3ae-6a4b6dde9cbd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:31:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:29 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 Jul 14 20:31:29 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:30 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.396s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:31:30 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cab2297-b28f-4a6d-a334-6816299ee6e0', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:31:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-7c76ab29-1aa8-4607-bdaa-aab4bfde742f req-4dccfe4b-078d-4006-826f-d5e88755d089 tempest-TestServerVolumeAttachmentScenario-415458385 None] attachment_update completed successfully. Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d876932-0cce-4759-ab09-06d8064bd356]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:34 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 Jul 14 20:31:34 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:34 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685" returned: 0 in 0.358s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.377s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:31:34 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-ec95bde6-cb16-498f-b54a-b40de3ce4685', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ca3cc8-7f49-4202-8768-f3473fedcf45', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:31:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-fe651383-09f6-473d-9199-0c5984d6d097 req-6a485e5d-11f5-454d-934a-f20b787327cb tempest-TestServerVolumeAttachmentScenario-415458385 None] attachment_update completed successfully. Jul 14 20:31:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-66284048-ce28-4868-baa8-32e314790144 req-0a5cac42-2918-49cf-9f56-e69395e01cea tempest-TestServerVolumeAttachmentScenario-415458385 None] Terminate volume connection completed successfully. Jul 14 20:31:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-66284048-ce28-4868-baa8-32e314790144 req-0a5cac42-2918-49cf-9f56-e69395e01cea tempest-TestServerVolumeAttachmentScenario-415458385 None] Deleting attachment 93ca3cc8-7f49-4202-8768-f3473fedcf45. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:31:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-3f458e38-651a-4011-9250-2301c5589b3c req-ce3be9cd-8fda-4b83-ab3d-1b9209a812eb tempest-TestServerVolumeAttachmentScenario-415458385 None] Terminate volume connection completed successfully. Jul 14 20:31:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-3f458e38-651a-4011-9250-2301c5589b3c req-ce3be9cd-8fda-4b83-ab3d-1b9209a812eb tempest-TestServerVolumeAttachmentScenario-415458385 None] Deleting attachment 8cab2297-b28f-4a6d-a334-6816299ee6e0. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "cinder-ec95bde6-cb16-498f-b54a-b40de3ce4685-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-ec95bde6-cb16-498f-b54a-b40de3ce4685-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "cinder-quobyte-ec95bde6-cb16-498f-b54a-b40de3ce4685" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-quobyte-ec95bde6-cb16-498f-b54a-b40de3ce4685" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d39e5-83c3-4a14-8bca-19b65c7b4f10]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:31:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:43 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 Jul 14 20:31:43 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:43 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:43 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685 Jul 14 20:31:43 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:43 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec95bde6-cb16-498f-b54a-b40de3ce4685" returned: 0 in 0.228s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-quobyte-ec95bde6-cb16-498f-b54a-b40de3ce4685" released by "delete_volume" :: held 0.598s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Created reservations ['af7bd441-84e9-4c20-b520-da831ed83f0a', '338c0ace-9720-4bb3-b3e3-40dc422699ca', '6f9345d1-20b9-4a70-b72c-859e1a69e670', '16e55413-9ed0-4612-a983-528b3a236fe7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:43 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:31:43 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:43 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.239s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:31:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Deleted volume successfully. Jul 14 20:31:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d7f0190d-8377-45de-8383-c6a4607380fe tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-ec95bde6-cb16-498f-b54a-b40de3ce4685-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "cinder-67ea3c87-a362-4c0a-b301-b5a4a5c85150-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-67ea3c87-a362-4c0a-b301-b5a4a5c85150-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "cinder-quobyte-67ea3c87-a362-4c0a-b301-b5a4a5c85150" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-quobyte-67ea3c87-a362-4c0a-b301-b5a4a5c85150" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd4a1a-900e-49df-8d88-a1f3a0b21a7c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:44 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 Jul 14 20:31:44 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:44 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150" returned: 0 in 0.337s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:44 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150 Jul 14 20:31:44 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:44 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-67ea3c87-a362-4c0a-b301-b5a4a5c85150" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-quobyte-67ea3c87-a362-4c0a-b301-b5a4a5c85150" released by "delete_volume" :: held 0.615s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Created reservations ['30677040-9ca3-44f1-91b4-537f5400eb41', 'c5f43ee7-883e-48ce-858a-bb70bdcc9c70', 'ecaf0ec2-4c70-408f-9216-f2171d7f58f9', '43e14c4b-628c-4787-8fc4-46a23b11cb0d'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:31:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:31:44 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:31:44 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:31:45 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 14 20:31:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.228s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:31:45 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:31:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Deleted volume successfully. Jul 14 20:31:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-f721ce46-4613-432d-9c36-110fd0a14f10 tempest-TestServerVolumeAttachmentScenario-415458385 None] Lock "cinder-67ea3c87-a362-4c0a-b301-b5a4a5c85150-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:31:54 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:31:55 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=25,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:03 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:32:03 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:03 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:32:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Flow 'volume_create_manager' (3358e152-5664-430e-85f2-52ab665b7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f62d5-a7fd-48ed-8107-ccebd60ba700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f62d5-a7fd-48ed-8107-ccebd60ba700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-901913772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa6cfe-a41b-4b35-8639-4d4316ebcd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09ce6231b4246fd988266c459f4846f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:32:16Z,use_quota=True,user_id='796efe8f1296470aac47ea8779718d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2daa98d-5eef-4794-9061-94057305789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2daa98d-5eef-4794-9061-94057305789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c44061-7d1f-42e4-aec5-9f674a4aa21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:15 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c44061-7d1f-42e4-aec5-9f674a4aa21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'volume_name': 'volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b64efe5-9713-4d09-93c8-fc7388f99fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b64efe5-9713-4d09-93c8-fc7388f99fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d1241d-e58b-4880-b0e0-381372d5599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:16 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Trying to clone 6faa6cfe-a41b-4b35-8639-4d4316ebcd21 from image a28aaf9a-7579-4123-bee1-aab6e137d44e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:32:16 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Image download 20.69 MB at 20.69 MB/s Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[be784369-f881-4ac8-9ef1-f7beabaca3d6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:16 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD Jul 14 20:32:16 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:16 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e is fetched for user 796efe8f1296470aac47ea8779718d27. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbfd058-922d-4ae6-994c-c1aae8867054]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:16 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD Jul 14 20:32:16 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:17 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-901913772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa6cfe-a41b-4b35-8639-4d4316ebcd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09ce6231b4246fd988266c459f4846f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:32:16Z,use_quota=True,user_id='796efe8f1296470aac47ea8779718d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Creating volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:32:17 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:17 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1073741824 Jul 14 20:32:17 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:17 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1073741824" returned: 0 in 0.400s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:17 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:17 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:17 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.248s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Attempting download of a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2ddc7-18f3-4793-9a7f-b951e750ddfd]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:18 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n Jul 14 20:32:18 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:18 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n" returned: 0 in 0.322s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:18 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n Jul 14 20:32:18 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:18 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n" returned: 1 in 0.321s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a28aaf9a-7579-4123-bee1-aab6e137d44e_7hb45d_n' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb04acc-742b-484c-aa5a-a75b54a6a0bd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:18 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD Jul 14 20:32:18 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:18 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] a28aaf9a-7579-4123-bee1-aab6e137d44e was qcow2, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:32:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:18 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:18 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:20 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 1.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a28aaf9a-7579-4123-bee1-aab6e137d44e_e0upi9ghdevstack@QuobyteHD, size 112.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:32:20 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Converted 112.00 MB image at 79.40 MB/s Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:20 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1G Jul 14 20:32:20 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:20 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 1G" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322c6f0-b109-4e31-b544-bf88926c48ea]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:20 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:20 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:20 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.333s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:21 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:21 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:21 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 1 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Downloaded image a28aaf9a-7579-4123-bee1-aab6e137d44e ((None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}])) to volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Temporary image a28aaf9a-7579-4123-bee1-aab6e137d44e for user 796efe8f1296470aac47ea8779718d27 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Marking volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Copying metadata from image a28aaf9a-7579-4123-bee1-aab6e137d44e to 6faa6cfe-a41b-4b35-8639-4d4316ebcd21. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Creating volume glance metadata for volume 6faa6cfe-a41b-4b35-8639-4d4316ebcd21 backed by image a28aaf9a-7579-4123-bee1-aab6e137d44e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d1241d-e58b-4880-b0e0-381372d5599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'volume_size': 1, 'image_id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a28aaf9a-7579-4123-bee1-aab6e137d44e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d6bf4424fd47e097f4b5a5c92a08a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a28aaf9a-7579-4123-bee1-aab6e137d44e', 'created_at': datetime.datetime(2026, 7, 14, 18, 10, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 10, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a28aaf9a-7579-4123-bee1-aab6e137d44e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a33172-c8cc-4b1c-9401-71bb4c157a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:32:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Volume volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 (6faa6cfe-a41b-4b35-8639-4d4316ebcd21): created successfully Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a33172-c8cc-4b1c-9401-71bb4c157a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:32:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Flow 'volume_create_manager' (3358e152-5664-430e-85f2-52ab665b7534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:32:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7bbfb1b1-a88e-4e7c-844f-1220d982c7e9 tempest-TestShelveInstance-356929597 None] Created volume successfully. Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[244cb198-f109-46ec-b786-b8c572e35076]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:24 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:24 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:24 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.417s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:24 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:24 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:25 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 1 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:32:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:32:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67eaf62e-db38-431e-a3f9-5421af2ee000', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:32:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-d8533195-2539-4651-8756-78ec70f73e4c req-3d34d368-8fb4-4c17-942d-5820a2ec3a28 tempest-TestShelveInstance-356929597 None] attachment_update completed successfully. Jul 14 20:32:35 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:32:35 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=8,cinder:SELECT=13,cinder:INSERT=5 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:32:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-2f6e696d-a837-4738-bc51-7fa24848e638 req-95fcbd84-6c99-43bc-ab5f-c3c66ae600ba tempest-TestShelveInstance-356929597 None] Terminate volume connection completed successfully. Jul 14 20:32:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-2f6e696d-a837-4738-bc51-7fa24848e638 req-95fcbd84-6c99-43bc-ab5f-c3c66ae600ba tempest-TestShelveInstance-356929597 None] Deleting attachment 67eaf62e-db38-431e-a3f9-5421af2ee000. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe52a6-80f7-487d-99ac-166901b6599d]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:55 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:55 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:55 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.343s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:32:56 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:32:56 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:32:56 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 14 20:32:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 1 in 0.318s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:32:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:32:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.698s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:32:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc', 'name': 'volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a92e89e-47ae-4c48-845c-8c77645573f0', 'enforce_multipath': True} {{(pid=87600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 20:32:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-4a98c852-5a82-4ee0-9250-212dc6cdc126 req-c6f788e4-4860-4fd1-b53a-cb14f60b7bcf tempest-TestShelveInstance-356929597 None] attachment_update completed successfully. Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:03 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:33:03 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:03 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:33:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:33:06 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:33:06 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:33:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-2ce0c9f5-0d8a-4860-8928-d64ffc02f632 tempest-TestShelveInstance-356929597 None] Terminate volume connection completed successfully. Jul 14 20:33:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-2ce0c9f5-0d8a-4860-8928-d64ffc02f632 tempest-TestShelveInstance-356929597 None] Deleting attachment 2a92e89e-47ae-4c48-845c-8c77645573f0. {{(pid=87600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Acquiring lock "cinder-6faa6cfe-a41b-4b35-8639-4d4316ebcd21-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "cinder-6faa6cfe-a41b-4b35-8639-4d4316ebcd21-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Acquiring lock "cinder-quobyte-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "cinder-quobyte-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3acc790-0b93-4c3c-aec0-1dede328780e]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:23 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:33:23 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:23 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:23 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:33:23 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:23 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 1 in 0.345s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:33:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:23 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21 Jul 14 20:33:23 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:24 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" returned: 0 in 0.232s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "cinder-quobyte-6faa6cfe-a41b-4b35-8639-4d4316ebcd21" released by "delete_volume" :: held 1.014s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.quota [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Created reservations ['67ec74a2-e9ea-4042-b147-2a120c1efb05', '1fcce5ce-bd13-4e3a-925d-e606917eaf2a', '3be4beef-d03b-4a30-87e7-cf2df9e7f5fd', '0111926c-82c5-47a3-8ad2-f0d9cc91a9f2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:24 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:33:24 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:24 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.235s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.manager [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:33:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Deleted volume successfully. Jul 14 20:33:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [req-ab01b506-08b1-470f-888a-ee890ae0d84a req-fa35d5b2-c61a-499e-b55e-5c12979cd07f tempest-TestShelveInstance-356929597 None] Lock "cinder-6faa6cfe-a41b-4b35-8639-4d4316ebcd21-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:33:34 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:33:34 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (3d219046-32b8-4f85-9250-eae47719dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060b1ca-2776-4b58-bfc9-1d99cff66763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060b1ca-2776-4b58-bfc9-1d99cff66763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1034008998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e324744e-0c62-4a45-a9d2-3e0f9b77982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:50Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259b682-1c2d-4962-bb7d-ff05096081c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259b682-1c2d-4962-bb7d-ff05096081c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7025a69b-a24c-47b9-a988-3c904e3b8f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7025a69b-a24c-47b9-a988-3c904e3b8f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e324744e-0c62-4a45-a9d2-3e0f9b77982a', 'volume_name': 'volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c32566-366c-4ee6-887e-95151b562c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c32566-366c-4ee6-887e-95151b562c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb1b4eb-fe6e-449e-b896-b2fef1ee28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Volume e324744e-0c62-4a45-a9d2-3e0f9b77982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a', 'volume_size': 1} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1034008998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e324744e-0c62-4a45-a9d2-3e0f9b77982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:50Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Creating volume e324744e-0c62-4a45-a9d2-3e0f9b77982a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:50 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (d906ab8c-dc9f-40e0-bd6e-223dc7006549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb29643-f99f-4830-9291-eaf76c50f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a 1073741824 Jul 14 20:33:50 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb29643-f99f-4830-9291-eaf76c50f768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497956099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66302867-63ad-4342-af13-5ec1b39f4573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:50Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640d031d-5e1d-4772-a578-0ce579fdf8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640d031d-5e1d-4772-a578-0ce579fdf8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41f2367-05d6-4cb7-8bf4-fc6ec0e1b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41f2367-05d6-4cb7-8bf4-fc6ec0e1b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66302867-63ad-4342-af13-5ec1b39f4573', 'volume_name': 'volume-66302867-63ad-4342-af13-5ec1b39f4573', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c885283-ef14-4673-b6ed-f05793db0ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c885283-ef14-4673-b6ed-f05793db0ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34a9b01-46c3-4f20-bbaf-e5649256f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 66302867-63ad-4342-af13-5ec1b39f4573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66302867-63ad-4342-af13-5ec1b39f4573', 'volume_size': 1} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (e24f9a49-3172-4311-9a3d-a470e67e4c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb730103-c673-4026-9ae2-476ce33ac423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb730103-c673-4026-9ae2-476ce33ac423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668529817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8f28d2-442e-44c9-b24a-353a3dd49978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cffa684-9ce0-4fbf-8384-a830523eec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cffa684-9ce0-4fbf-8384-a830523eec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51bc0b0-1e3e-40c3-b48d-b8ea787f3a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51bc0b0-1e3e-40c3-b48d-b8ea787f3a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8f28d2-442e-44c9-b24a-353a3dd49978', 'volume_name': 'volume-ec8f28d2-442e-44c9-b24a-353a3dd49978', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:50 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75027730-73cb-4cb6-ba2f-13f49438aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75027730-73cb-4cb6-ba2f-13f49438aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de9d073-2d1b-450d-93ee-a19813998041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Volume ec8f28d2-442e-44c9-b24a-353a3dd49978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8f28d2-442e-44c9-b24a-353a3dd49978', 'volume_size': 1} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:51 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Flow 'volume_create_manager' (8298e831-1c4c-4a80-9b52-a0e93f718d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e21765-a50d-42dc-ba1a-0438cf2f644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a 1073741824" returned: 0 in 0.706s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e21765-a50d-42dc-ba1a-0438cf2f644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-600414144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b6e332-38e8-4200-bdd3-e7100407e548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a8db7917934be598d929a6cce83044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='9ec9ae01f245490ebc33f787cda62552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d023c0-238b-41b2-8b7e-f3da2b7340fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d023c0-238b-41b2-8b7e-f3da2b7340fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dd50d6-f2f6-449a-ac2e-1070560d0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dd50d6-f2f6-449a-ac2e-1070560d0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b6e332-38e8-4200-bdd3-e7100407e548', 'volume_name': 'volume-d6b6e332-38e8-4200-bdd3-e7100407e548', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90e1b26-619f-42d7-9166-bf6b0f4b4d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90e1b26-619f-42d7-9166-bf6b0f4b4d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad36deb-dbea-4c54-bed1-572e3831820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Volume d6b6e332-38e8-4200-bdd3-e7100407e548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b6e332-38e8-4200-bdd3-e7100407e548', 'volume_size': 1} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (ad620013-a8d5-4055-a99c-af854a2d355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fbb341-0248-4041-8463-627d00b0e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fbb341-0248-4041-8463-627d00b0e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572102878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a61a84-f484-4484-9a45-17af455f97bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30923526-f689-4714-bd39-7655529a40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30923526-f689-4714-bd39-7655529a40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6b806a-f3fd-4187-b502-a358cfb8c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6b806a-f3fd-4187-b502-a358cfb8c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a61a84-f484-4484-9a45-17af455f97bc', 'volume_name': 'volume-32a61a84-f484-4484-9a45-17af455f97bc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440631da-8f40-4952-a3f8-68baadb18f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440631da-8f40-4952-a3f8-68baadb18f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22114c72-2b48-40a2-9827-4a37200181e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Volume 32a61a84-f484-4484-9a45-17af455f97bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a61a84-f484-4484-9a45-17af455f97bc', 'volume_size': 1} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:51 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a Jul 14 20:33:51 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (9e0f7383-8530-4dbc-b656-912ec7e50e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d123b627-4c71-4a0a-bff4-f212e0113696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d123b627-4c71-4a0a-bff4-f212e0113696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c659a3b8-dbbb-4946-90ed-71934ffeae86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:52Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b65ede-afbe-455f-a3a1-929e0eb22640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b65ede-afbe-455f-a3a1-929e0eb22640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53e5118-b255-4d2d-888d-5bf5195cb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53e5118-b255-4d2d-888d-5bf5195cb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c659a3b8-dbbb-4946-90ed-71934ffeae86', 'volume_name': 'volume-c659a3b8-dbbb-4946-90ed-71934ffeae86', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eaba69-7a14-434f-b17d-e7a4f4a11c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eaba69-7a14-434f-b17d-e7a4f4a11c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6f38f-e8fd-439a-a5e3-72d5f053426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:51 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Volume c659a3b8-dbbb-4946-90ed-71934ffeae86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c659a3b8-dbbb-4946-90ed-71934ffeae86', 'volume_size': 1} Jul 14 20:33:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:52 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a" returned: 0 in 0.350s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497956099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66302867-63ad-4342-af13-5ec1b39f4573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:50Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb1b4eb-fe6e-449e-b896-b2fef1ee28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 1073741824 Jul 14 20:33:52 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bb6543-6ae4-43fe-bc02-21d0419a064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Volume volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a (e324744e-0c62-4a45-a9d2-3e0f9b77982a): created successfully Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bb6543-6ae4-43fe-bc02-21d0419a064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (3d219046-32b8-4f85-9250-eae47719dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e3c46603-2f2d-40f9-8953-29c455fa96a1 tempest-CreateVolumesFromImageTest-1660772847 None] Created volume successfully. Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (826bdcb1-de7a-47a0-a62d-6e56f2e7091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc88a7-74fa-452d-870d-f0d0241be8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc88a7-74fa-452d-870d-f0d0241be8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-751918632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee96670-a581-40ad-9271-541946107135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:52Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390ba99-d4f9-43af-a5f6-aa05ae3d47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390ba99-d4f9-43af-a5f6-aa05ae3d47e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eb2351-ec36-400f-9e2d-13e2b012338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eb2351-ec36-400f-9e2d-13e2b012338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee96670-a581-40ad-9271-541946107135', 'volume_name': 'volume-6ee96670-a581-40ad-9271-541946107135', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ca6f9b-04d6-4729-8063-0d1aed552e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ca6f9b-04d6-4729-8063-0d1aed552e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e74e96-6c2c-46c8-b2b8-35c8eb0bc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Volume 6ee96670-a581-40ad-9271-541946107135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee96670-a581-40ad-9271-541946107135', 'volume_size': 1} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:52 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 1073741824" returned: 0 in 0.500s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:52 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 Jul 14 20:33:52 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:52 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668529817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8f28d2-442e-44c9-b24a-353a3dd49978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Creating volume ec8f28d2-442e-44c9-b24a-353a3dd49978 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34a9b01-46c3-4f20-bbaf-e5649256f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66302867-63ad-4342-af13-5ec1b39f4573', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c5668f-0480-446c-a92d-50237ff8cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:52 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 1073741824 Jul 14 20:33:52 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-66302867-63ad-4342-af13-5ec1b39f4573 (66302867-63ad-4342-af13-5ec1b39f4573): created successfully Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c5668f-0480-446c-a92d-50237ff8cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (d906ab8c-dc9f-40e0-bd6e-223dc7006549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b65684c0-918d-4050-9a2f-f53b36c4a3a9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:33:53 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 1073741824" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:53 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 Jul 14 20:33:53 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:53 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-600414144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b6e332-38e8-4200-bdd3-e7100407e548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a8db7917934be598d929a6cce83044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='9ec9ae01f245490ebc33f787cda62552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Creating volume d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:53 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:53 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 1073741824 Jul 14 20:33:53 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de9d073-2d1b-450d-93ee-a19813998041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8f28d2-442e-44c9-b24a-353a3dd49978', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b28a92-5ce0-4b2d-8b1c-bd8b5665a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:53 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Volume volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 (ec8f28d2-442e-44c9-b24a-353a3dd49978): created successfully Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b28a92-5ce0-4b2d-8b1c-bd8b5665a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:53 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (e24f9a49-3172-4311-9a3d-a470e67e4c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:53 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ac0adb23-0146-4b26-a574-4a94bafdd543 tempest-CreateVolumesFromImageTest-1660772847 None] Created volume successfully. Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:54 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 1073741824" returned: 0 in 0.534s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:54 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:33:54 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:54 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.831s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572102878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a61a84-f484-4484-9a45-17af455f97bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:51Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Creating volume 32a61a84-f484-4484-9a45-17af455f97bc {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:54 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad36deb-dbea-4c54-bed1-572e3831820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b6e332-38e8-4200-bdd3-e7100407e548', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809949d9-074b-44c2-a684-9d2709c88e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:54 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc 1073741824 Jul 14 20:33:54 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Volume volume-d6b6e332-38e8-4200-bdd3-e7100407e548 (d6b6e332-38e8-4200-bdd3-e7100407e548): created successfully Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809949d9-074b-44c2-a684-9d2709c88e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Flow 'volume_create_manager' (8298e831-1c4c-4a80-9b52-a0e93f718d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-59f2d6e1-ddd5-412e-932f-767c54ebf361 tempest-VolumeDependencyTests-1182668875 None] Created volume successfully. Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Flow 'volume_create_manager' (1b4e8084-2307-469f-b2a2-c0ec958e9c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bb1404-9795-4d1b-9d64-09e015359892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bb1404-9795-4d1b-9d64-09e015359892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50272e5f-629f-496e-b2ca-f239245dbb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9db584fba124401b2b1b5ae5d549afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:55Z,use_quota=True,user_id='ead459a519e04d0782aa1f2411862cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5a15d24-bc96-4e71-9661-3c15c4d6c5c6),volume_type_id=e5a15d24-bc96-4e71-9661-3c15c4d6c5c6)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8bcd0d-9f9f-4844-8b14-264501ee9bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:54 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8bcd0d-9f9f-4844-8b14-264501ee9bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258fdc2b-cfbe-49cc-b301-cd95cb0bee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc 1073741824" returned: 0 in 0.480s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:55 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc Jul 14 20:33:55 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258fdc2b-cfbe-49cc-b301-cd95cb0bee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50272e5f-629f-496e-b2ca-f239245dbb69', 'volume_name': 'volume-50272e5f-629f-496e-b2ca-f239245dbb69', 'volume_size': 1, 'image_id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbc31314b5a541df6d424ef1db18ddcd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9db584fba124401b2b1b5ae5d549afa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdaf4218cf427e6217054e9a46be1e1ed46c8e8604a4c9b45f47369855be48c45b5ab4ab9f464d2ff4ff87f434cabacc6665759d34d96cc72493eff5a3e666a7', 'id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'created_at': datetime.datetime(2026, 7, 14, 18, 33, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 33, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c51e2ed-8180-46bb-8e56-7e539a067692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c51e2ed-8180-46bb-8e56-7e539a067692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c471346a-51c9-4c51-8e48-234893eaa8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Volume 50272e5f-629f-496e-b2ca-f239245dbb69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50272e5f-629f-496e-b2ca-f239245dbb69', 'volume_size': 1, 'image_id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbc31314b5a541df6d424ef1db18ddcd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9db584fba124401b2b1b5ae5d549afa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdaf4218cf427e6217054e9a46be1e1ed46c8e8604a4c9b45f47369855be48c45b5ab4ab9f464d2ff4ff87f434cabacc6665759d34d96cc72493eff5a3e666a7', 'id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'created_at': datetime.datetime(2026, 7, 14, 18, 33, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 33, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Trying to clone 50272e5f-629f-496e-b2ca-f239245dbb69 from image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:33:55 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c659a3b8-dbbb-4946-90ed-71934ffeae86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:52Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Creating volume c659a3b8-dbbb-4946-90ed-71934ffeae86 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:55 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22114c72-2b48-40a2-9827-4a37200181e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a61a84-f484-4484-9a45-17af455f97bc', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14597045-5cc7-4e11-86bf-7ea837488623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:55 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 1073741824 Jul 14 20:33:55 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Volume volume-32a61a84-f484-4484-9a45-17af455f97bc (32a61a84-f484-4484-9a45-17af455f97bc): created successfully Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14597045-5cc7-4e11-86bf-7ea837488623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (ad620013-a8d5-4055-a99c-af854a2d355c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:33:55 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Image download 0.00 MB at 0.00 MB/s Jul 14 20:33:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7e51d7da-e673-492c-98a3-41ec977ff470 tempest-CreateVolumesFromImageTest-1660772847 None] Created volume successfully. Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e5826-fe5e-462e-b75d-bf0264f44fde]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:55 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:33:55 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:55 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:55 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 1073741824" returned: 0 in 0.522s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:55 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 Jul 14 20:33:55 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:55 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:33:55 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:56 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Temporary image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 is fetched for user ead459a519e04d0782aa1f2411862cd5. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.811s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-751918632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee96670-a581-40ad-9271-541946107135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f55bf4168664171bcc847487725e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:52Z,use_quota=True,user_id='e2cf1bc8e8554014bee4ab1476f0b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Creating volume 6ee96670-a581-40ad-9271-541946107135 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:33:56 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:56 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 1073741824 Jul 14 20:33:56 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6f38f-e8fd-439a-a5e3-72d5f053426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c659a3b8-dbbb-4946-90ed-71934ffeae86', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9929c7-fdf9-4c19-b9dc-a0436ee4c9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:56 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Volume volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 (c659a3b8-dbbb-4946-90ed-71934ffeae86): created successfully Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9929c7-fdf9-4c19-b9dc-a0436ee4c9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (9e0f7383-8530-4dbc-b656-912ec7e50e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e984ca-ec5e-4549-8e10-befa820b601b]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9551af23-52b4-4d2a-859d-074b80377ce5 tempest-CreateVolumesFromImageTest-1660772847 None] Created volume successfully. Jul 14 20:33:56 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:33:56 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:56 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:56 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 1073741824" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:56 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 Jul 14 20:33:56 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:56 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:33:56 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:56 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.668s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e74e96-6c2c-46c8-b2b8-35c8eb0bc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee96670-a581-40ad-9271-541946107135', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb8d961-0ad8-4f2e-b483-78a738db4ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:33:56 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating offline snapshot d474a538-d5fc-454b-96d9-e22d6282fe79 of volume 66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:33:56 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Volume volume-6ee96670-a581-40ad-9271-541946107135 (6ee96670-a581-40ad-9271-541946107135): created successfully Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb8d961-0ad8-4f2e-b483-78a738db4ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Flow 'volume_create_manager' (826bdcb1-de7a-47a0-a62d-6e56f2e7091d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1d062-4918-4a4c-9811-05c0b9a2800e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:56 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d1036421-8a44-46f9-bbe2-a4f412bea262 tempest-CreateVolumesFromImageTest-1660772847 None] Created volume successfully. Jul 14 20:33:57 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 Jul 14 20:33:57 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:57 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573" returned: 0 in 0.342s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:57 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 1G Jul 14 20:33:57 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:57 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 1G" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66302867-63ad-4342-af13-5ec1b39f4573 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:57 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66302867-63ad-4342-af13-5ec1b39f4573 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 Jul 14 20:33:57 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-6ee96670-a581-40ad-9271-541946107135-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-6ee96670-a581-40ad-9271-541946107135-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-quobyte-6ee96670-a581-40ad-9271-541946107135" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-6ee96670-a581-40ad-9271-541946107135" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ba6fb-b900-4000-9adf-17622c5ecb2d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:57 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 Jul 14 20:33:57 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:57 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66302867-63ad-4342-af13-5ec1b39f4573 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:57 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 is being set with open permissions: ugo+rw Jul 14 20:33:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:57 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 Jul 14 20:33:57 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:58 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79" returned: 0 in 0.228s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135" returned: 0 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:58 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135 Jul 14 20:33:58 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:58 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info Jul 14 20:33:58 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:58 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ee96670-a581-40ad-9271-541946107135" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-6ee96670-a581-40ad-9271-541946107135" released by "delete_volume" :: held 0.686s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:33:58 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info is being set with open permissions: ugo+rw Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:58 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info Jul 14 20:33:58 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Created reservations ['0db46973-a158-4faa-adeb-e1e7afe7df09', '599ba0e5-1b57-4549-8abd-77b131d9b481', '64f4b303-e479-4514-987e-0b28368d92e1', '2650f892-9181-41ce-8e95-c37dc7a22608'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:58 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:33:58 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:58 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.info" returned: 0 in 0.269s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.120s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Creating offline snapshot 36b7db22-a298-4847-a9af-bb622a00ca08 of volume d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa2bf6-c836-430b-ab08-d80b0c0305c1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-980266dc-96d3-4937-9ad7-760d1f42ef93 tempest-CreateVolumesFromSnapshotTest-941890680 None] Create snapshot completed successfully Jul 14 20:33:58 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.321s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:33:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-c659a3b8-dbbb-4946-90ed-71934ffeae86-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Deleted volume successfully. Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-18229a92-7260-4d86-ad68-b18c66576bf1 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-6ee96670-a581-40ad-9271-541946107135-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-c659a3b8-dbbb-4946-90ed-71934ffeae86-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-quobyte-c659a3b8-dbbb-4946-90ed-71934ffeae86" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-c659a3b8-dbbb-4946-90ed-71934ffeae86" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:33:59 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:33:59 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea161b8-1842-44a2-a050-29d8d0b33b3e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:59 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 Jul 14 20:33:59 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:59 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.468s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:59 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 1G Jul 14 20:33:59 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:59 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:59 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86 Jul 14 20:33:59 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:59 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c659a3b8-dbbb-4946-90ed-71934ffeae86" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-c659a3b8-dbbb-4946-90ed-71934ffeae86" released by "delete_volume" :: held 0.726s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Created reservations ['0442b0bd-b118-473f-a0fb-da5faa683d9b', '3dafdb23-c44b-43dc-bb6d-17f9767556b4', '84998d83-dfb0-49d4-a4b1-c4bfb621a1f2', 'fa06c57c-b5a4-43b8-8943-bc71d2d28447'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:33:59 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 1G" returned: 0 in 0.543s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6e332-38e8-4200-bdd3-e7100407e548 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:33:59 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6e332-38e8-4200-bdd3-e7100407e548 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:33:59 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:33:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (3058ed57-ba4a-4d36-97ac-af47f597324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:00 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:00 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a364589-d10c-4c4b-aa18-02eb8bc6d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a364589-d10c-4c4b-aa18-02eb8bc6d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29663364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d4027e-e6b4-42f0-89eb-c9d67ce8e28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:00Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8aa3fb-2486-4768-91b3-0ec06c98b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8aa3fb-2486-4768-91b3-0ec06c98b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c122d-fe24-4670-9629-5ed890b26cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c122d-fe24-4670-9629-5ed890b26cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d4027e-e6b4-42f0-89eb-c9d67ce8e28b', 'volume_name': 'volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234fc2c2-5f4e-4b3a-a371-792fd9244ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234fc2c2-5f4e-4b3a-a371-792fd9244ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bd4730-8e73-43ba-9190-7e9a42bbeb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 58d4027e-e6b4-42f0-89eb-c9d67ce8e28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b', 'volume_size': 1} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-32a61a84-f484-4484-9a45-17af455f97bc-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-32a61a84-f484-4484-9a45-17af455f97bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:00 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-quobyte-32a61a84-f484-4484-9a45-17af455f97bc" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Deleted volume successfully. Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-32a61a84-f484-4484-9a45-17af455f97bc" acquired by "delete_volume" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:00 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6e332-38e8-4200-bdd3-e7100407e548 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:00 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 is being set with open permissions: ugo+rw Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ef85d533-33f3-4e42-8fb7-126a162d6800 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-c659a3b8-dbbb-4946-90ed-71934ffeae86-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad272d-a3a7-43a0-b479-9a17543f0286]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:00 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:34:00 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:00 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc Jul 14 20:34:00 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (df2806a2-38ea-4f99-ab51-26b55c37a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7b82fe-bbb9-4d55-98ad-6cd22e11a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7b82fe-bbb9-4d55-98ad-6cd22e11a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988198848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df1e867-d215-47e5-aa4a-2b8feee32d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:00Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e84d2b1-d1ea-4d3d-a1ae-be056509cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e84d2b1-d1ea-4d3d-a1ae-be056509cb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fd8fee-f0cf-4a77-9348-a8257f20ff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fd8fee-f0cf-4a77-9348-a8257f20ff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df1e867-d215-47e5-aa4a-2b8feee32d88', 'volume_name': 'volume-0df1e867-d215-47e5-aa4a-2b8feee32d88', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799678b6-fa61-4586-a34a-c30c7fcc9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799678b6-fa61-4586-a34a-c30c7fcc9f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d8fdea-c082-44b8-b237-27316e70a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 0df1e867-d215-47e5-aa4a-2b8feee32d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df1e867-d215-47e5-aa4a-2b8feee32d88', 'volume_size': 1} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:00 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:00 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info Jul 14 20:34:00 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:00 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:00 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc Jul 14 20:34:00 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:01 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (642b279a-31aa-4312-9a15-d644c9b1934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deffa6d4-13c7-48fc-a831-3ccc0a8c50a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:01 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info is being set with open permissions: ugo+rw Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deffa6d4-13c7-48fc-a831-3ccc0a8c50a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101255858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c84c50f-d04f-4b7f-a142-729752f262a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:01Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info Jul 14 20:34:01 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8da260-883a-4483-b13a-a5475493b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8da260-883a-4483-b13a-a5475493b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dbdb77-5000-493b-8030-2aaa7a59df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dbdb77-5000-493b-8030-2aaa7a59df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c84c50f-d04f-4b7f-a142-729752f262a2', 'volume_name': 'volume-6c84c50f-d04f-4b7f-a142-729752f262a2', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9689ac5-8afa-4a4a-9f3f-d1438ad2b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9689ac5-8afa-4a4a-9f3f-d1438ad2b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bf7b63-8f13-47c0-9904-a78ab13192cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 6c84c50f-d04f-4b7f-a142-729752f262a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c84c50f-d04f-4b7f-a142-729752f262a2', 'volume_size': 1} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:01 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-32a61a84-f484-4484-9a45-17af455f97bc" returned: 0 in 0.314s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-32a61a84-f484-4484-9a45-17af455f97bc" released by "delete_volume" :: held 0.821s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Created reservations ['af2384d6-cb29-401c-b960-81035f4b42a9', '17aab350-394a-416a-b1b4-0022816a067a', '36b81a8c-fb64-43d3-afe8-64ac8caa26d4', '0b2fbed8-4eff-45e5-8845-784e5d91e21e'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:01 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:01 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:01 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (f779839a-ae9f-4f2a-b955-6fd14d2ca9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1591e13e-6720-4bee-8ed6-982a028fe8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.info" returned: 0 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.630s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50272e5f-629f-496e-b2ca-f239245dbb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9db584fba124401b2b1b5ae5d549afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:33:55Z,use_quota=True,user_id='ead459a519e04d0782aa1f2411862cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5a15d24-bc96-4e71-9661-3c15c4d6c5c6),volume_type_id=e5a15d24-bc96-4e71-9661-3c15c4d6c5c6)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Creating volume 50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-ec8f28d2-442e-44c9-b24a-353a3dd49978-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:01 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1073741824 Jul 14 20:34:01 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1591e13e-6720-4bee-8ed6-982a028fe8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290516349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e33e64-5838-4c20-8366-30b48584c7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:01Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930afed9-728d-473f-abd9-6b008db5c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930afed9-728d-473f-abd9-6b008db5c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdad6f1-2a26-46be-b9d4-b82317900972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdad6f1-2a26-46be-b9d4-b82317900972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e33e64-5838-4c20-8366-30b48584c7a8', 'volume_name': 'volume-58e33e64-5838-4c20-8366-30b48584c7a8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564ef1d2-ec5c-4143-a04a-a409a44ae830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564ef1d2-ec5c-4143-a04a-a409a44ae830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ba1073-5b35-4faf-9c78-d9fc9bf55ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 58e33e64-5838-4c20-8366-30b48584c7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e33e64-5838-4c20-8366-30b48584c7a8', 'volume_size': 1} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-ec8f28d2-442e-44c9-b24a-353a3dd49978-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dea0da73-dfa5-4a68-9cc5-ee07eb5c3f44 tempest-VolumeDependencyTests-1182668875 None] Create snapshot completed successfully Jul 14 20:34:01 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.382s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-quobyte-ec8f28d2-442e-44c9-b24a-353a3dd49978" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Deleted volume successfully. Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-ec8f28d2-442e-44c9-b24a-353a3dd49978" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d827a9-ecc2-489a-bdbd-47b3ec88a55e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bec798fe-6c06-4448-aa15-b2958b1f5069 tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-32a61a84-f484-4484-9a45-17af455f97bc-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (e11e1d6a-72e6-4dcd-8251-49a254f80333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c7647b-1f78-44c2-9755-60801112ebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c7647b-1f78-44c2-9755-60801112ebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172980618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766ca995-d7e1-4d85-bb7a-8633b07fe9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:02Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45131ec-b47f-4a56-bfa4-312bb0a33275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45131ec-b47f-4a56-bfa4-312bb0a33275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec69ed-ef60-46a1-af9a-13e6f328d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec69ed-ef60-46a1-af9a-13e6f328d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766ca995-d7e1-4d85-bb7a-8633b07fe9a3', 'volume_name': 'volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 Jul 14 20:34:01 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5019d2ef-c689-4af7-8ccc-3ecb407981c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5019d2ef-c689-4af7-8ccc-3ecb407981c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfa7b4-6190-4a96-b6c4-6cb824ef9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume 766ca995-d7e1-4d85-bb7a-8633b07fe9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3', 'volume_size': 1} Jul 14 20:34:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:02 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1073741824" returned: 0 in 0.637s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:02 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978" returned: 0 in 0.412s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:02 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:02 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:02 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978 Jul 14 20:34:02 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:02 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-29663364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d4027e-e6b4-42f0-89eb-c9d67ce8e28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:00Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 58d4027e-e6b4-42f0-89eb-c9d67ce8e28b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:02 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:02 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b 1073741824 Jul 14 20:34:02 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Attempting download of ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}])) to volume 50272e5f-629f-496e-b2ca-f239245dbb69. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:34:02 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ec8f28d2-442e-44c9-b24a-353a3dd49978" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-ec8f28d2-442e-44c9-b24a-353a3dd49978" released by "delete_volume" :: held 0.831s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac99664-5983-4690-b2fb-4325b0b8e35f]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Created reservations ['7b391e4d-08b0-4d6a-854d-652aae18c508', '9a9da0fa-6761-49d7-8a4e-9dcb946728b3', '2e755bf7-553e-4a3a-ae63-6e64d37a01ac', '127cf6c4-1aaa-4a27-a10d-51b709b21aa3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:02 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o Jul 14 20:34:02 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Flow 'volume_create_manager' (c2d44181-cbd4-4560-a5fe-7f96f8763287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeba80b-c8f1-476e-93a5-4ff8772301c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeba80b-c8f1-476e-93a5-4ff8772301c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1912037125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a8db7917934be598d929a6cce83044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36b7db22-a298-4847-a9af-bb622a00ca08,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:03Z,use_quota=True,user_id='9ec9ae01f245490ebc33f787cda62552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbee0d0d-2e73-489d-8f54-e6662210a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbee0d0d-2e73-489d-8f54-e6662210a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff699170-66e2-4a26-8d4c-b53ceb7d3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff699170-66e2-4a26-8d4c-b53ceb7d3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1', 'volume_name': 'volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1', 'volume_size': 1, 'snapshot_id': '36b7db22-a298-4847-a9af-bb622a00ca08'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb9c4e5-4a9f-4014-b4f0-41b8847e3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb9c4e5-4a9f-4014-b4f0-41b8847e3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004c7c3d-224f-4215-8527-4864f105da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:02 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Volume 3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1', 'volume_size': 1, 'snapshot_id': '36b7db22-a298-4847-a9af-bb622a00ca08'} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:02 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:02 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:02 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b 1073741824" returned: 0 in 0.518s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o" returned: 0 in 0.422s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b Jul 14 20:34:03 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o Jul 14 20:34:03 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Deleted volume successfully. Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-42ec8849-309c-4356-bdec-5e124417768b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-ec8f28d2-442e-44c9-b24a-353a3dd49978-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:03 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.619s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988198848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df1e867-d215-47e5-aa4a-2b8feee32d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:00Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 0df1e867-d215-47e5-aa4a-2b8feee32d88 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:03 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 1073741824 Jul 14 20:34:03 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bd4730-8e73-43ba-9190-7e9a42bbeb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:03 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cac8b55-44eb-421e-a184-37cc62f55c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:03 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b (58d4027e-e6b4-42f0-89eb-c9d67ce8e28b): created successfully Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cac8b55-44eb-421e-a184-37cc62f55c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (3058ed57-ba4a-4d36-97ac-af47f597324e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:03 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5acfc4ab-c506-4332-9d57-6e014ac03abe tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o" returned: 1 in 0.380s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_zg_ke11o' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[febfce6c-d89d-47fe-8ced-a19eb52b9ffd]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:34:03 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.341s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:34:03 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 1073741824" returned: 0 in 0.505s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:03 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 Jul 14 20:34:03 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-e324744e-0c62-4a45-a9d2-3e0f9b77982a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:03 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD Jul 14 20:34:03 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-e324744e-0c62-4a45-a9d2-3e0f9b77982a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "cinder-quobyte-e324744e-0c62-4a45-a9d2-3e0f9b77982a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-e324744e-0c62-4a45-a9d2-3e0f9b77982a" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4b0d1b-b9cb-4db5-9722-c2ccc7d021bb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a Jul 14 20:34:04 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88" returned: 0 in 0.289s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101255858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c84c50f-d04f-4b7f-a142-729752f262a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:01Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 6c84c50f-d04f-4b7f-a142-729752f262a2 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:04 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:04 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 was raw, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 1073741824 Jul 14 20:34:04 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d8fdea-c082-44b8-b237-27316e70a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df1e867-d215-47e5-aa4a-2b8feee32d88', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b7a5f8-527e-4077-8c18-a4cbc3a5f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:04 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:04 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 (0df1e867-d215-47e5-aa4a-2b8feee32d88): created successfully Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b7a5f8-527e-4077-8c18-a4cbc3a5f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (df2806a2-38ea-4f99-ab51-26b55c37a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-50efe382-a63b-4838-9e2d-b776b1d0c06b tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:34:04 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a Jul 14 20:34:04 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 0 in 0.389s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7_o04xega3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:34:04 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1G Jul 14 20:34:04 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 1073741824" returned: 0 in 0.515s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e324744e-0c62-4a45-a9d2-3e0f9b77982a" returned: 0 in 0.319s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-quobyte-e324744e-0c62-4a45-a9d2-3e0f9b77982a" released by "delete_volume" :: held 0.740s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 Jul 14 20:34:04 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Created reservations ['f7f48641-9098-41a8-b605-3f85498e8cdf', '3917bb7a-cc62-470f-ae07-e7bf6defe25c', '2c2139b6-dda7-4af3-805c-468f9bde4b51', '40961bbb-d017-428a-9cd7-fd7aed1110a2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:04 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 1G" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:04 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:04 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed9da4-dd9e-48d7-be36-d98fa2b04179]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:05 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2" returned: 0 in 0.306s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.409s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290516349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e33e64-5838-4c20-8366-30b48584c7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:01Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 58e33e64-5838-4c20-8366-30b48584c7a8 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:05 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:05 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bf7b63-8f13-47c0-9904-a78ab13192cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c84c50f-d04f-4b7f-a142-729752f262a2', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:05 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 1073741824 Jul 14 20:34:05 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9639151-ab9f-4f12-85d3-e72d4a458262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-6c84c50f-d04f-4b7f-a142-729752f262a2 (6c84c50f-d04f-4b7f-a142-729752f262a2): created successfully Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9639151-ab9f-4f12-85d3-e72d4a458262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (642b279a-31aa-4312-9a15-d644c9b1934a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a867ca6f-e844-449a-a252-24e28122f519 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:34:05 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.346s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Deleted volume successfully. Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-eef253f0-b773-4ca4-b56f-337b2d745d5b tempest-CreateVolumesFromImageTest-1660772847 None] Lock "cinder-e324744e-0c62-4a45-a9d2-3e0f9b77982a-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:05 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:05 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:05 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:05 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 1073741824" returned: 0 in 0.563s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:05 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 Jul 14 20:34:05 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:05 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 1 in 0.427s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Downloaded image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}])) to volume 50272e5f-629f-496e-b2ca-f239245dbb69 successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Temporary image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 for user ead459a519e04d0782aa1f2411862cd5 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Marking volume 50272e5f-629f-496e-b2ca-f239245dbb69 as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Copying metadata from image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 to 50272e5f-629f-496e-b2ca-f239245dbb69. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Creating volume glance metadata for volume 50272e5f-629f-496e-b2ca-f239245dbb69 backed by image ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbc31314b5a541df6d424ef1db18ddcd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c471346a-51c9-4c51-8e48-234893eaa8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50272e5f-629f-496e-b2ca-f239245dbb69', 'volume_size': 1, 'image_id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbc31314b5a541df6d424ef1db18ddcd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9db584fba124401b2b1b5ae5d549afa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdaf4218cf427e6217054e9a46be1e1ed46c8e8604a4c9b45f47369855be48c45b5ab4ab9f464d2ff4ff87f434cabacc6665759d34d96cc72493eff5a3e666a7', 'id': 'ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7', 'created_at': datetime.datetime(2026, 7, 14, 18, 33, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 33, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce8e80d9-61fa-4922-a6dd-b32aa8d1ecc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a742ddb-82e6-47a5-ab41-2bc8dcedfddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Volume volume-50272e5f-629f-496e-b2ca-f239245dbb69 (50272e5f-629f-496e-b2ca-f239245dbb69): created successfully Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a742ddb-82e6-47a5-ab41-2bc8dcedfddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Flow 'volume_create_manager' (1b4e8084-2307-469f-b2a2-c0ec958e9c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:05 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-888b5f0e-dea3-4c07-a626-fd2e16c012ff tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Created volume successfully. Jul 14 20:34:05 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.087s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172980618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766ca995-d7e1-4d85-bb7a-8633b07fe9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae7c4eae2f8047b68a653e669deba12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:02Z,use_quota=True,user_id='f470c3dfa20d444aa4eb1a8b00734a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Creating volume 766ca995-d7e1-4d85-bb7a-8633b07fe9a3 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:06 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ba1073-5b35-4faf-9c78-d9fc9bf55ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e33e64-5838-4c20-8366-30b48584c7a8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:06 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 1073741824 Jul 14 20:34:06 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d0774d-981a-4cfd-b07e-a0ab4d1d9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:06 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-58e33e64-5838-4c20-8366-30b48584c7a8 (58e33e64-5838-4c20-8366-30b48584c7a8): created successfully Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d0774d-981a-4cfd-b07e-a0ab4d1d9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (f779839a-ae9f-4f2a-b955-6fd14d2ca9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-21ef5dee-88cc-4eda-ba09-f5331bce64cb tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:34:06 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 1073741824" returned: 0 in 0.499s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:06 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 Jul 14 20:34:06 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Acquiring lock "cinder-50272e5f-629f-496e-b2ca-f239245dbb69-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "cinder-50272e5f-629f-496e-b2ca-f239245dbb69-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:06 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" returned: 0 in 0.318s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.965s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Acquiring lock "cinder-quobyte-50272e5f-629f-496e-b2ca-f239245dbb69" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dfa7b4-6190-4a96-b6c4-6cb824ef9e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af9317-e542-4e94-b7dc-cbb1a1939715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:06 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Volume volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 (766ca995-d7e1-4d85-bb7a-8633b07fe9a3): created successfully Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af9317-e542-4e94-b7dc-cbb1a1939715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Flow 'volume_create_manager' (e11e1d6a-72e6-4dcd-8251-49a254f80333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "cinder-quobyte-50272e5f-629f-496e-b2ca-f239245dbb69" acquired by "delete_volume" :: waited 0.049s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Creating volume 3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 from snapshot 36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-74f4ad29-691a-4f63-93c0-c20616993c06 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created volume successfully. Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] snapshot: 36b7db22-a298-4847-a9af-bb622a00ca08, volume: 3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6c4206-df90-4da6-99a9-cb23beb0f158]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e615a7-fdde-4b62-9d59-89b3cebe99b4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:07 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:34:07 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-766ca995-d7e1-4d85-bb7a-8633b07fe9a3-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-766ca995-d7e1-4d85-bb7a-8633b07fe9a3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:07 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 0 in 0.427s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2982497-0293-4666-90a3-5dcb285a4a6f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.468s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b6e332-38e8-4200-bdd3-e7100407e548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2460830b-8180-4838-94b5-753efb9b8ba7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:07 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 Jul 14 20:34:07 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:34:07 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 1 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:07 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69 Jul 14 20:34:07 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:07 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:08 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3 Jul 14 20:34:08 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:08 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.535s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:08 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 Jul 14 20:34:08 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:08 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-50272e5f-629f-496e-b2ca-f239245dbb69" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "cinder-quobyte-50272e5f-629f-496e-b2ca-f239245dbb69" released by "delete_volume" :: held 1.246s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Created reservations ['cfbf41ff-64c5-4f9c-840f-8589817af0f4', '30a65e6b-a1cf-4c8a-925d-174d198bd904', '005c182b-eea3-4bda-bda9-b95556afa9a1', '3fa86238-ea4f-466e-9c0b-35e3e8790f6b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:08 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-766ca995-d7e1-4d85-bb7a-8633b07fe9a3" released by "delete_volume" :: held 0.841s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['3580434d-116a-4291-b9c4-5008b9b26feb', '9587efb0-8894-4056-b1d9-97f4568c9ce4', 'e8345644-e987-4824-aad7-4ea1ac6d2e0f', '174a0a52-afb7-4783-b161-cdd50fd38394'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:08 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:08 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:08 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:08 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-58e33e64-5838-4c20-8366-30b48584c7a8-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-58e33e64-5838-4c20-8366-30b48584c7a8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-58e33e64-5838-4c20-8366-30b48584c7a8" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-58e33e64-5838-4c20-8366-30b48584c7a8" acquired by "delete_volume" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5a30d-b976-43e2-8de2-41d0667563e5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:08 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.565s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:08 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Deleted volume successfully. Jul 14 20:34:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9a654e29-2b73-4bb3-98e3-9b6f0df94301 tempest-VolumeAndVolumeTypeFromImageTest-1506811928 None] Lock "cinder-50272e5f-629f-496e-b2ca-f239245dbb69-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:09 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 Jul 14 20:34:09 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:09 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.878s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:09 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:09 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7410b305-fd0b-4d1b-bf95-af0c892cbae9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-766ca995-d7e1-4d85-bb7a-8633b07fe9a3-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:10 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8" returned: 0 in 1.427s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:10 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8 Jul 14 20:34:10 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (649e04f9-26fe-4f8e-ab2d-e474857b4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cb065a-0a1a-4624-ac1e-676c369d2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cb065a-0a1a-4624-ac1e-676c369d2ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451340256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d287cff-e8ad-4181-83e6-3f40edbcf80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:10Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee740fb6-03c2-44f6-af5b-da82fa03461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee740fb6-03c2-44f6-af5b-da82fa03461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b283b1b-4f3f-4d1a-8e25-30aa790a8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b283b1b-4f3f-4d1a-8e25-30aa790a8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d287cff-e8ad-4181-83e6-3f40edbcf80f', 'volume_name': 'volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf4dd73-4588-4622-bad2-f40d10f240f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf4dd73-4588-4622-bad2-f40d10f240f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637fef9-4a9c-445a-8e43-de5823998a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:10 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Volume 0d287cff-e8ad-4181-83e6-3f40edbcf80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f', 'volume_size': 1} Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:10 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58e33e64-5838-4c20-8366-30b48584c7a8" returned: 0 in 0.769s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-58e33e64-5838-4c20-8366-30b48584c7a8" released by "delete_volume" :: held 2.282s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['9f642018-b0c6-47e8-9b76-7baa34463b4e', '59e3d748-fd4b-4fd6-978d-6064e1c78a2b', '29f9d42f-d9c7-4576-aadc-32c5c18a24f8', '107b6598-b41c-48cc-939a-90d13d183fe4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:11 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:11 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:11 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.467s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:11 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ac275809-1f2c-4edf-8a07-4b229c32ec18 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-58e33e64-5838-4c20-8366-30b48584c7a8-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-6c84c50f-d04f-4b7f-a142-729752f262a2-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-6c84c50f-d04f-4b7f-a142-729752f262a2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-6c84c50f-d04f-4b7f-a142-729752f262a2" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-6c84c50f-d04f-4b7f-a142-729752f262a2" acquired by "delete_volume" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd84da-ff09-4cdc-b888-a6af3d782b15]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:13 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 Jul 14 20:34:13 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:13 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2" returned: 0 in 0.662s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:13 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2 Jul 14 20:34:13 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:14 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6c84c50f-d04f-4b7f-a142-729752f262a2" returned: 0 in 0.607s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-6c84c50f-d04f-4b7f-a142-729752f262a2" released by "delete_volume" :: held 1.365s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:14 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" returned: 0 in 6.194s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2ee0e-6cef-4ce0-9403-de8732f29d5b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['6c6c4b96-e6b6-4b7f-b91d-44fd05f386d9', 'f227cd26-e342-4d51-afc3-325266ab813b', 'f938ee7c-91c1-4556-9573-85fe9543fd42', '51f47dbb-ce2c-4e4e-9c83-0aaa24bd6cda'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:14 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:34:14 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:14 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:14 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:14 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.272s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:14 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e8717a27-79b4-4595-a9e9-39320a6fe08e tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-6c84c50f-d04f-4b7f-a142-729752f262a2-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:14 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.556s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:34:14 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Converted 1024.00 MB image at 165.31 MB/s Jul 14 20:34:14 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 is being set with open permissions: ugo+rw Jul 14 20:34:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:14 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 Jul 14 20:34:14 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:15 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" returned: 0 in 0.248s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" released by "_copy_volume_from_snapshot" :: held 8.135s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" released by "_create_volume_from_snapshot" :: held 8.174s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.242s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.412s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451340256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d287cff-e8ad-4181-83e6-3f40edbcf80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:10Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Creating volume 0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:15 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:15 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f 1073741824 Jul 14 20:34:15 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004c7c3d-224f-4215-8527-4864f105da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1', 'volume_size': 1, 'snapshot_id': '36b7db22-a298-4847-a9af-bb622a00ca08'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689e5704-a941-49aa-aa62-a63e201d12df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Volume volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 (3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1): created successfully Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689e5704-a941-49aa-aa62-a63e201d12df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Flow 'volume_create_manager' (c2d44181-cbd4-4560-a5fe-7f96f8763287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:15 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7fc54f0e-73e8-4e4d-8fdb-c0f2aa9cabe5 tempest-VolumeDependencyTests-1182668875 None] Created volume successfully. Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-0df1e867-d215-47e5-aa4a-2b8feee32d88-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-0df1e867-d215-47e5-aa4a-2b8feee32d88-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-0df1e867-d215-47e5-aa4a-2b8feee32d88" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-0df1e867-d215-47e5-aa4a-2b8feee32d88" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074b292-2e68-43c8-9206-c1d12e6497c5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:15 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 Jul 14 20:34:15 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:15 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f 1073741824" returned: 0 in 0.605s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:15 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f Jul 14 20:34:15 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:15 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:15 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88 Jul 14 20:34:15 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:16 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f" returned: 0 in 0.261s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637fef9-4a9c-445a-8e43-de5823998a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56789bb9-2c35-45e5-b27b-3a42346c07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:16 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Volume volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f (0d287cff-e8ad-4181-83e6-3f40edbcf80f): created successfully Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56789bb9-2c35-45e5-b27b-3a42346c07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (649e04f9-26fe-4f8e-ab2d-e474857b4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:16 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0df1e867-d215-47e5-aa4a-2b8feee32d88" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-0df1e867-d215-47e5-aa4a-2b8feee32d88" released by "delete_volume" :: held 0.709s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:16 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-dc5a62b4-dbd6-40d6-b029-a50692b45171 tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['afb8af67-3be6-4457-9438-5396aa28f707', '230d2ebe-c105-4620-b98d-7dcfc848d57d', '7d007dad-ffff-4f60-8d93-eb1c763c7f21', '6e6045e8-e4a0-4d4b-95f5-0d0b7014caac'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:16 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:16 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-36b7db22-a298-4847-a9af-bb622a00ca08-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-36b7db22-a298-4847-a9af-bb622a00ca08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Deleting offline snapshot 36b7db22-a298-4847-a9af-bb622a00ca08 of volume d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] snapshot_file for this snap is: volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0630b4-b336-49a3-b1c1-6769e96d09c4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:16 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.310s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:16 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-88abfbfe-0537-4562-b2ef-784b09d72c0b tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-0df1e867-d215-47e5-aa4a-2b8feee32d88-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:16 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:34:16 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[527331e4-e0ff-4041-8097-a208fc5e60aa]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:16 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b Jul 14 20:34:16 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:16 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b6e332-38e8-4200-bdd3-e7100407e548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca841a71-1ce2-4bde-9010-bc21da7b6df8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:34:17 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" returned: 0 in 0.469s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b Jul 14 20:34:17 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:34:17 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" returned: 0 in 0.322s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b" released by "delete_volume" :: held 0.850s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Creating offline snapshot 289f233b-7d1e-4297-82f3-d1f3211de475 of volume 0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (2faf754d-7920-4993-92cd-607f55685f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a40020-9e04-4ebf-ad1a-2561158d94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd73137f-54d5-41e1-b54b-844be8745fe6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a40020-9e04-4ebf-ad1a-2561158d94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312789392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806d3f34-5163-44b4-aa61-60d17efc47b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:17Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f8dce9-ed8f-4e56-9ad7-17b1c9b8be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f8dce9-ed8f-4e56-9ad7-17b1c9b8be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948f8bf-b891-4d01-9b80-10fdde0723f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948f8bf-b891-4d01-9b80-10fdde0723f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806d3f34-5163-44b4-aa61-60d17efc47b8', 'volume_name': 'volume-806d3f34-5163-44b4-aa61-60d17efc47b8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb62532-4fae-4cb7-8569-95c705c2a53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb62532-4fae-4cb7-8569-95c705c2a53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a55940-8864-48ea-8b18-d74a8ac1277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:17 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume 806d3f34-5163-44b4-aa61-60d17efc47b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806d3f34-5163-44b4-aa61-60d17efc47b8', 'volume_size': 1} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:17 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f Jul 14 20:34:17 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['a62edd25-cbb7-4f46-ad1e-8f6fcca94f92', '4585c50f-eb1a-4141-970a-dbdb1b780dd0', '05c6f5be-594e-4e22-aa50-3e9d567b12ce', '23ddf547-8332-436d-aa5b-29caab1d5fa6'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:17 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.441s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08 Jul 14 20:34:17 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:17 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:17 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 1G Jul 14 20:34:17 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:18 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-6f1612a3-42f6-4833-bfa2-16acc70dd2f9 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-58d4027e-e6b4-42f0-89eb-c9d67ce8e28b-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:18 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548.36b7db22-a298-4847-a9af-bb622a00ca08" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-36b7db22-a298-4847-a9af-bb622a00ca08" released by "_delete_snapshot" :: held 1.667s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" released by "delete_snapshot" :: held 1.701s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Created reservations ['e15914b3-a23c-4c15-aef1-6e3379861158', '6e637fe0-02c9-490e-a966-debd9db9bc3f', 'b590a0c2-c1df-4fea-8728-cfdfb4d8e227', '1fdbf569-bebd-44e1-aef5-8cb466d0bc70'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Delete snapshot completed successfully. Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25d3b9fc-2eb8-4207-8284-c36a05b64300 tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-36b7db22-a298-4847-a9af-bb622a00ca08-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:18 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 1G" returned: 0 in 0.444s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:18 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 Jul 14 20:34:18 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-d6b6e332-38e8-4200-bdd3-e7100407e548-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-d6b6e332-38e8-4200-bdd3-e7100407e548-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[44182bfa-e8af-4fed-9e08-d31afba4abd3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:18 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475" returned: 0 in 0.330s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:18 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 is being set with open permissions: ugo+rw Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:18 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 Jul 14 20:34:18 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-d474a538-d5fc-454b-96d9-e22d6282fe79-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-d474a538-d5fc-454b-96d9-e22d6282fe79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:18 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:34:18 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-d474a538-d5fc-454b-96d9-e22d6282fe79" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-d474a538-d5fc-454b-96d9-e22d6282fe79" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleting offline snapshot d474a538-d5fc-454b-96d9-e22d6282fe79 of volume 66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] snapshot_file for this snap is: volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a88e6f3-01cd-4f0a-9680-27f924bca6c7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:18 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475" returned: 0 in 0.250s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:18 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 Jul 14 20:34:18 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info Jul 14 20:34:19 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548 Jul 14 20:34:19 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79" returned: 0 in 0.377s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66302867-63ad-4342-af13-5ec1b39f4573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:19 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info is being set with open permissions: ugo+rw Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a69896-6bca-4d23-aeb9-ed5aae2e95b0]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info Jul 14 20:34:19 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-d6b6e332-38e8-4200-bdd3-e7100407e548" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-d6b6e332-38e8-4200-bdd3-e7100407e548" released by "delete_volume" :: held 0.703s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:19 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 Jul 14 20:34:19 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Created reservations ['4ca4ce7e-0394-48c1-a3fc-5842e8ed4962', '32c5d8c6-5bc9-4858-957f-bd3335551359', 'f91a1f7a-71da-4f44-b8e5-ccc583ebc278', 'c94b433c-82ba-4195-be36-6c726a943086'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.info" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:19 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312789392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806d3f34-5163-44b4-aa61-60d17efc47b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:17Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume 806d3f34-5163-44b4-aa61-60d17efc47b8 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:19 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 1073741824 Jul 14 20:34:19 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bae71c60-6130-4e69-8ba2-2bb070081c17 tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:34:19 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573" returned: 0 in 0.430s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:19 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 Jul 14 20:34:19 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:19 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:19 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Deleted volume successfully. Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5a56e0be-8641-4164-b7bc-bddef089973a tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-d6b6e332-38e8-4200-bdd3-e7100407e548-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd9735-7d09-4f53-8d7c-a1d464940d4b]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 Jul 14 20:34:20 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 1073741824" returned: 0 in 0.569s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79 Jul 14 20:34:20 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 Jul 14 20:34:20 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" returned: 0 in 0.385s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1 Jul 14 20:34:20 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573.d474a538-d5fc-454b-96d9-e22d6282fe79" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8" returned: 0 in 0.266s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-d474a538-d5fc-454b-96d9-e22d6282fe79" released by "_delete_snapshot" :: held 1.611s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" released by "delete_snapshot" :: held 1.634s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a55940-8864-48ea-8b18-d74a8ac1277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806d3f34-5163-44b4-aa61-60d17efc47b8', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c687d532-68e8-4a37-a47d-1a29236cec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:20 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-806d3f34-5163-44b4-aa61-60d17efc47b8 (806d3f34-5163-44b4-aa61-60d17efc47b8): created successfully Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c687d532-68e8-4a37-a47d-1a29236cec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (2faf754d-7920-4993-92cd-607f55685f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-efaf2578-c055-4bfd-a4e5-d32a57bb5ced tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-289f233b-7d1e-4297-82f3-d1f3211de475-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['0345e567-6bd6-4bf8-ab55-0b256e32aea7', '9a39c0a5-c54f-4013-b892-4e17a545a2a7', '695b0ec7-9f5b-4264-b003-74b800093e9e', 'c250f055-1386-46bf-9a85-79c03162a210'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:20 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-289f233b-7d1e-4297-82f3-d1f3211de475-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" returned: 0 in 0.273s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-289f233b-7d1e-4297-82f3-d1f3211de475" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-quobyte-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1" released by "delete_volume" :: held 0.720s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-289f233b-7d1e-4297-82f3-d1f3211de475" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot 289f233b-7d1e-4297-82f3-d1f3211de475 of volume 0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8c628-52e5-4d3e-a50b-ed9f415a4b1a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Delete snapshot completed successfully. Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae2342f4-7269-4f69-81f2-8369410bca26 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-d474a538-d5fc-454b-96d9-e22d6282fe79-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Created reservations ['10a5bc4f-7735-4a70-9220-c5989e0521b4', 'a58b674e-ff6c-4dda-ba71-7a42af3e8387', '1fbf183e-27b1-4697-ae77-afb31700d754', 'cd1aae5e-d7c4-4c93-8acf-5c0bc1b96435'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:20 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 Jul 14 20:34:20 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:20 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:20 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-66302867-63ad-4342-af13-5ec1b39f4573-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-66302867-63ad-4342-af13-5ec1b39f4573-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:21 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:21 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Deleted volume successfully. Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:21 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475" returned: 0 in 0.447s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7f722-82ae-48d3-bbd8-72e680ec1fb4]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc660d1-637a-447e-bc22-5411cbdba0d1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a3817ed-abbf-4ad9-b5ec-8840a02f5c5b tempest-VolumeDependencyTests-1182668875 None] Lock "cinder-3ab7ae11-1d1e-4fb2-8e08-53f1843d62b1-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:21 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 Jul 14 20:34:21 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:21 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f Jul 14 20:34:21 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:21 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573" returned: 0 in 0.398s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:21 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f" returned: 0 in 0.402s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:21 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573 Jul 14 20:34:21 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:21 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 Jul 14 20:34:21 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:21 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-66302867-63ad-4342-af13-5ec1b39f4573" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-quobyte-66302867-63ad-4342-af13-5ec1b39f4573" released by "delete_volume" :: held 0.812s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:21 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Created reservations ['0f40f33e-43bc-4255-a611-5df2464aea62', 'c230c803-8cb3-4351-be9d-4ed07da3a919', 'd3016a72-ba30-4070-b948-b9bf8c18c521', 'abcfbdd2-9b14-48a9-b363-765094e15f45'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:22 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475" returned: 0 in 0.541s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:22 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475 Jul 14 20:34:22 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:22 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:22 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (8f5f922e-70a0-4e5b-9249-ff0c6b04c9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4989452b-8f7a-4b16-a003-7d2207774d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4989452b-8f7a-4b16-a003-7d2207774d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185586907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:22Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714ed839-7cb4-44ca-bf5a-4ddf403de249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714ed839-7cb4-44ca-bf5a-4ddf403de249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eacac5-8412-4d6d-b9e7-233953838203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eacac5-8412-4d6d-b9e7-233953838203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c', 'volume_name': 'volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ee8bde-a618-47dd-a2ee-6dfa0c777cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ee8bde-a618-47dd-a2ee-6dfa0c777cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626556ee-920f-4da1-aad6-bc3a766b7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume 21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c', 'volume_size': 1} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185586907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:22Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume 21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:22 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:22 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c 1073741824 Jul 14 20:34:22 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:22 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.401s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Deleted volume successfully. Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2410c90f-14d3-4117-8fe8-a84226634587 tempest-CreateVolumesFromSnapshotTest-941890680 None] Lock "cinder-66302867-63ad-4342-af13-5ec1b39f4573-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:22 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f.289f233b-7d1e-4297-82f3-d1f3211de475" returned: 0 in 0.649s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (67b0c662-ce6c-470f-978a-80557c5380fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1943f8d1-973f-4d07-8e8a-4c6db560b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-289f233b-7d1e-4297-82f3-d1f3211de475" released by "_delete_snapshot" :: held 2.252s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1943f8d1-973f-4d07-8e8a-4c6db560b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274551849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2344625a-ee59-4fa4-bb7b-804ff890ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:23Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da44acb6-6d80-4040-b114-09dcf32a9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da44acb6-6d80-4040-b114-09dcf32a9f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d1a554-75b6-4540-9b67-87bd9c7ab9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d1a554-75b6-4540-9b67-87bd9c7ab9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2344625a-ee59-4fa4-bb7b-804ff890ba7b', 'volume_name': 'volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3bebfe-6dc1-481c-ba84-f6fd3ba3596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3bebfe-6dc1-481c-ba84-f6fd3ba3596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c879f1fe-0f99-4d41-b317-170b4b304b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:22 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume 2344625a-ee59-4fa4-bb7b-804ff890ba7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b', 'volume_size': 1} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:22 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" released by "delete_snapshot" :: held 2.362s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Created reservations ['5e1c65f4-a76e-4fda-9f91-a065b0d03b14', 'bf6381e2-001c-4c0a-9413-e6fd8bd16d5c', 'f400bfe9-13c9-4874-a8bf-241241a8f50e', 'cdc3024a-eef2-45e4-988d-8ebf50df25fa'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:34:23 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c 1073741824" returned: 0 in 0.682s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ba0b4344-d249-4ab3-85d5-1b463076fed6 tempest-ProjectMemberTests-646539804 None] Lock "cinder-289f233b-7d1e-4297-82f3-d1f3211de475-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:23 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c Jul 14 20:34:23 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (900858c0-3d3f-460e-8b78-9509ecaf32f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78be671-3962-4209-851d-3361c35825c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78be671-3962-4209-851d-3361c35825c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553268046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ee0f29-418a-4c2f-add9-840eb1ac86c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:23Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0003ffd0-39ab-4d5e-baa3-e26c1f0a1ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0003ffd0-39ab-4d5e-baa3-e26c1f0a1ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77adc523-7940-4958-99ad-ba15a48b65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77adc523-7940-4958-99ad-ba15a48b65be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ee0f29-418a-4c2f-add9-840eb1ac86c3', 'volume_name': 'volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82deacdb-f98f-4d6a-8444-5f7590846d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82deacdb-f98f-4d6a-8444-5f7590846d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d1e8ce-e32a-4176-bd61-779f8d86847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume f9ee0f29-418a-4c2f-add9-840eb1ac86c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3', 'volume_size': 1} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:23 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" returned: 0 in 0.333s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274551849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2344625a-ee59-4fa4-bb7b-804ff890ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:23Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume 2344625a-ee59-4fa4-bb7b-804ff890ba7b {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:23 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:23 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b 1073741824 Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626556ee-920f-4da1-aad6-bc3a766b7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb2d0fe-9e9a-4bd1-9cff-a250d5637bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:23 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c (21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c): created successfully Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb2d0fe-9e9a-4bd1-9cff-a250d5637bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:23 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (8f5f922e-70a0-4e5b-9249-ff0c6b04c9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:23 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-53d35f0c-a9e8-4494-b8fe-7b8caaab9610 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (d7b9e48d-060d-4b1d-a87b-49e5abf9f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d220ba5d-9e3d-4b8f-8b09-366bde82e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d220ba5d-9e3d-4b8f-8b09-366bde82e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-880401568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879bb18a-75be-41db-9084-2b5a1d93829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:24Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea7f12-231f-41c7-93fc-82d385d5ca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea7f12-231f-41c7-93fc-82d385d5ca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799ddd43-46bb-4d25-8467-09c000a0e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799ddd43-46bb-4d25-8467-09c000a0e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879bb18a-75be-41db-9084-2b5a1d93829e', 'volume_name': 'volume-879bb18a-75be-41db-9084-2b5a1d93829e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f877980-0b65-404f-910b-46e055465705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f877980-0b65-404f-910b-46e055465705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfcaa0-7d53-463f-a4af-cf1a91c54b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume 879bb18a-75be-41db-9084-2b5a1d93829e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879bb18a-75be-41db-9084-2b5a1d93829e', 'volume_size': 1} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:24 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b 1073741824" returned: 0 in 0.721s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-0d287cff-e8ad-4181-83e6-3f40edbcf80f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "cinder-0d287cff-e8ad-4181-83e6-3f40edbcf80f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:24 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b Jul 14 20:34:24 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" acquired by "delete_volume" :: waited 0.034s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (5c4db307-47da-4d75-be1b-c0b867c29ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246247c2-a5a1-4e3d-9465-50a19e5c9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583ff55-d5bb-4356-9622-2226267bed35]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246247c2-a5a1-4e3d-9465-50a19e5c9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042300311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c091a6b8-77c2-4df7-80bd-4258413daa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:25Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b533be89-ac12-4e23-b1d7-09c2ef840091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b533be89-ac12-4e23-b1d7-09c2ef840091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654f30c7-6778-4f69-998b-95546f707963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654f30c7-6778-4f69-998b-95546f707963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c091a6b8-77c2-4df7-80bd-4258413daa25', 'volume_name': 'volume-c091a6b8-77c2-4df7-80bd-4258413daa25', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e205734-67bf-46db-9f4b-63316af99d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e205734-67bf-46db-9f4b-63316af99d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0393499d-2e9f-42e6-b944-6c5a3a368532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume c091a6b8-77c2-4df7-80bd-4258413daa25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c091a6b8-77c2-4df7-80bd-4258413daa25', 'volume_size': 1} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:24 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553268046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ee0f29-418a-4c2f-add9-840eb1ac86c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:23Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume f9ee0f29-418a-4c2f-add9-840eb1ac86c3 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:24 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:24 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f Jul 14 20:34:24 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c879f1fe-0f99-4d41-b317-170b4b304b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 1073741824 Jul 14 20:34:24 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42aa203-e9a2-4a00-85af-39745cfdc5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:24 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b (2344625a-ee59-4fa4-bb7b-804ff890ba7b): created successfully Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42aa203-e9a2-4a00-85af-39745cfdc5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:24 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (67b0c662-ce6c-470f-978a-80557c5380fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c942deea-3bbb-4598-b557-658f596a4aa7 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:25 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f" returned: 0 in 0.471s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:25 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f Jul 14 20:34:25 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:25 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 1073741824" returned: 0 in 0.578s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:25 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-0d287cff-e8ad-4181-83e6-3f40edbcf80f" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-0d287cff-e8ad-4181-83e6-3f40edbcf80f" released by "delete_volume" :: held 0.883s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:25 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 Jul 14 20:34:25 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Created reservations ['fa0f3bf6-1427-4955-9aa2-895307b1ad9e', '9913fee8-3c64-42d3-afaf-d95edf0dfd79', 'c40f864a-f2c6-4777-a8c4-1bb85f12fa75', 'cbcd2ac9-2649-4303-9794-4cc2181f5157'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:25 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:25 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:25 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" returned: 0 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-880401568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879bb18a-75be-41db-9084-2b5a1d93829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:24Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume 879bb18a-75be-41db-9084-2b5a1d93829e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:25 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d1e8ce-e32a-4176-bd61-779f8d86847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e149b6-42ad-4945-a650-22180192402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:25 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e 1073741824 Jul 14 20:34:25 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 (f9ee0f29-418a-4c2f-add9-840eb1ac86c3): created successfully Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e149b6-42ad-4945-a650-22180192402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (900858c0-3d3f-460e-8b78-9509ecaf32f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7b969671-1ad1-4586-ae64-37ef8e5883be tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:26 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.401s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c761ccc6-2b9e-46b0-a644-11b0b46d7000 tempest-ProjectMemberTests-646539804 None] Lock "cinder-0d287cff-e8ad-4181-83e6-3f40edbcf80f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:26 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e 1073741824" returned: 0 in 0.506s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:26 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e Jul 14 20:34:26 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:26 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e" returned: 0 in 0.327s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042300311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c091a6b8-77c2-4df7-80bd-4258413daa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c06ac51cc4bc2b7245fd215e3fde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:25Z,use_quota=True,user_id='cdae53aa14864bf686ae991293766829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Creating volume c091a6b8-77c2-4df7-80bd-4258413daa25 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:26 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfcaa0-7d53-463f-a4af-cf1a91c54b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879bb18a-75be-41db-9084-2b5a1d93829e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:26 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 1073741824 Jul 14 20:34:26 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d29a0c2-c859-4d15-a91a-4bed6890b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:26 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-879bb18a-75be-41db-9084-2b5a1d93829e (879bb18a-75be-41db-9084-2b5a1d93829e): created successfully Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d29a0c2-c859-4d15-a91a-4bed6890b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:26 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (d7b9e48d-060d-4b1d-a87b-49e5abf9f800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-36568d7b-9da0-4306-9680-99777eff540b tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:27 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 1073741824" returned: 0 in 0.657s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:27 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 Jul 14 20:34:27 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (2ad59186-f606-4503-b4fe-df9346d219b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1beaf2-b342-4912-a0a3-aac5a02db7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (c0febd7f-4604-4206-a885-7ce12a2898ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43dba48-4828-43dc-925b-2f0abfc1bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1beaf2-b342-4912-a0a3-aac5a02db7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519234425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14af0bfe-7e47-4b65-8fc5-da2aa9ca191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:28Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b27e6c-7c24-4139-b864-4c7db9d0bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b27e6c-7c24-4139-b864-4c7db9d0bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b985961f-7619-4750-bebe-ef2379a1f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b985961f-7619-4750-bebe-ef2379a1f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14af0bfe-7e47-4b65-8fc5-da2aa9ca191e', 'volume_name': 'volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48ecdf6-7cf6-469a-8b53-d3b907013033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48ecdf6-7cf6-469a-8b53-d3b907013033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a885bb5-1606-4e58-82c6-d5e926b10e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Volume 14af0bfe-7e47-4b65-8fc5-da2aa9ca191e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e', 'volume_size': 1} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43dba48-4828-43dc-925b-2f0abfc1bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837528776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7511422-3d7e-4ff0-9b28-106e5df75bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:28Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bba58b-a4dc-4fc0-b197-81e8dbdbf822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bba58b-a4dc-4fc0-b197-81e8dbdbf822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a73848-703e-4917-846d-5a272af581a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a73848-703e-4917-846d-5a272af581a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7511422-3d7e-4ff0-9b28-106e5df75bdf', 'volume_name': 'volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2997a773-2342-41b6-8a39-eace7c3128e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2997a773-2342-41b6-8a39-eace7c3128e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7250f8a7-0094-4bb4-a262-e1e8965589f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Volume c7511422-3d7e-4ff0-9b28-106e5df75bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf', 'volume_size': 1} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:27 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519234425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14af0bfe-7e47-4b65-8fc5-da2aa9ca191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:28Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Creating volume 14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:27 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0393499d-2e9f-42e6-b944-6c5a3a368532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c091a6b8-77c2-4df7-80bd-4258413daa25', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e 1073741824 Jul 14 20:34:27 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a60cf-d00a-48ca-9a8b-e4d56fc185ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:27 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Volume volume-c091a6b8-77c2-4df7-80bd-4258413daa25 (c091a6b8-77c2-4df7-80bd-4258413daa25): created successfully Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a60cf-d00a-48ca-9a8b-e4d56fc185ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:27 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Flow 'volume_create_manager' (5c4db307-47da-4d75-be1b-c0b867c29ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-674e3f73-eb08-4534-9761-847fc93f9a90 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created volume successfully. Jul 14 20:34:28 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e 1073741824" returned: 0 in 0.443s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:28 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e Jul 14 20:34:28 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-c091a6b8-77c2-4df7-80bd-4258413daa25-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-c091a6b8-77c2-4df7-80bd-4258413daa25-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-c091a6b8-77c2-4df7-80bd-4258413daa25" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:28 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" returned: 0 in 0.291s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837528776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7511422-3d7e-4ff0-9b28-106e5df75bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:28Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Creating volume c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:28 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-c091a6b8-77c2-4df7-80bd-4258413daa25" acquired by "delete_volume" :: waited 0.057s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:28 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf 1073741824 Jul 14 20:34:28 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a885bb5-1606-4e58-82c6-d5e926b10e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c8aea3-7bad-4cea-89f5-a0caee15e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45cb25-1068-47fc-8f46-9165aa13019a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:28 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Volume volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e (14af0bfe-7e47-4b65-8fc5-da2aa9ca191e): created successfully Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c8aea3-7bad-4cea-89f5-a0caee15e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (2ad59186-f606-4503-b4fe-df9346d219b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:28 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6ebf76b4-79cd-4cf8-8c19-2b98142a4daa tempest-ProjectReaderTests-1124851849 None] Created volume successfully. Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Flow 'volume_create_manager' (b034ad6c-662c-49c8-a44a-18ff23ab4de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33902ddf-26ce-4ed5-8c28-72f60b11ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33902ddf-26ce-4ed5-8c28-72f60b11ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bd066b-2ccc-4cf7-9afc-58029bb4ca4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d419a42a7643ad85bd1f097df97fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:29Z,use_quota=True,user_id='3eaa05fa9f0a40bc9cdd7d9172e102d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a776b10-6747-4427-86f4-27d407477ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:28 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 Jul 14 20:34:28 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a776b10-6747-4427-86f4-27d407477ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c65091-4a99-4323-8434-9f74097ccac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:28 devstack cinder-volume[87600]: DEBUG cinder.image.glance [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Creating Keystone auth plugin from conf {{(pid=87600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c65091-4a99-4323-8434-9f74097ccac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85bd066b-2ccc-4cf7-9afc-58029bb4ca4f', 'volume_name': 'volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f', 'volume_size': 1, 'image_id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ddf4b1bf616c0b3c32a5ac186d1c134', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d419a42a7643ad85bd1f097df97fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416845c6079f61ae4c8cdc6788a98d889d5d2217d3dff7f4f47a25ada984cf30c4dd39196c370eda015fc404e785379c1a13c7cbe006157edc996696e37a5924', 'id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'created_at': datetime.datetime(2026, 7, 14, 18, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1752d540-513e-448b-9b95-512191f18541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1752d540-513e-448b-9b95-512191f18541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62007a0-0ec9-430d-b367-aebf6afd36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f', 'volume_size': 1, 'image_id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ddf4b1bf616c0b3c32a5ac186d1c134', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d419a42a7643ad85bd1f097df97fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416845c6079f61ae4c8cdc6788a98d889d5d2217d3dff7f4f47a25ada984cf30c4dd39196c370eda015fc404e785379c1a13c7cbe006157edc996696e37a5924', 'id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'created_at': datetime.datetime(2026, 7, 14, 18, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348/file', 'properties': {}}, 'image_service': } Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Trying to clone 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f from image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}]). {{(pid=87600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 20:34:29 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25" returned: 0 in 0.417s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf 1073741824" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25 Jul 14 20:34:29 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 20:34:29 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Image download 0.00 MB at 0.00 MB/s Jul 14 20:34:29 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf Jul 14 20:34:29 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae804fc-09ca-47aa-b66d-603cfdce33e3]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:29 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:29 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c091a6b8-77c2-4df7-80bd-4258413daa25" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-c091a6b8-77c2-4df7-80bd-4258413daa25" released by "delete_volume" :: held 0.757s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:29 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf" returned: 0 in 0.273s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7250f8a7-0094-4bb4-a262-e1e8965589f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70f0ed4-6b21-4cc6-b42e-4edfc4e9544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Volume volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf (c7511422-3d7e-4ff0-9b28-106e5df75bdf): created successfully Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70f0ed4-6b21-4cc6-b42e-4edfc4e9544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (c0febd7f-4604-4206-a885-7ce12a2898ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9a2d1746-f403-4837-97de-673f47cb025e tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['ce41ffa6-ae1c-4461-97a3-f225f442e4d8', '09c71a06-7e7e-400f-8d0a-093f60a162cd', '87f859c9-b111-4dd2-a307-def5bb8a2c37', 'b06a38a1-d2da-4c90-af83-31e5b80d3cd0'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:29 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-879bb18a-75be-41db-9084-2b5a1d93829e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-879bb18a-75be-41db-9084-2b5a1d93829e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:29 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:29 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Creating offline snapshot 6a11c769-b530-4ad1-b629-2c84c12fc972 of volume 14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-879bb18a-75be-41db-9084-2b5a1d93829e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6995d0-75d6-47d6-b316-0938d7cc10dd]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-879bb18a-75be-41db-9084-2b5a1d93829e" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb4b60-cc24-4e24-b78f-965f83f76bf3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:29 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3af15da6-8c96-4d15-adf8-e0b44b02d887 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-c091a6b8-77c2-4df7-80bd-4258413daa25-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:29 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e Jul 14 20:34:29 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e Jul 14 20:34:30 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Temporary image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 is fetched for user 3eaa05fa9f0a40bc9cdd7d9172e102d4. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee822f00-e51b-4cfa-b91d-0f2fa87c3b89]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:30 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 1G Jul 14 20:34:30 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e" returned: 0 in 0.401s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e Jul 14 20:34:30 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-879bb18a-75be-41db-9084-2b5a1d93829e" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:30 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-879bb18a-75be-41db-9084-2b5a1d93829e" released by "delete_volume" :: held 0.710s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['71ce29fa-fc04-4751-ab02-e1de07e482d2', 'ea1c2d1f-0740-407c-8df8-b2190c424f22', 'fd0e0379-d650-4224-b1e5-558e9fef35b5', 'd2f4b4a3-c454-4bda-8357-94978031b791'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:30 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 1G" returned: 0 in 0.472s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 Jul 14 20:34:30 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:30 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:30 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:30 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-f9ee0f29-418a-4c2f-add9-840eb1ac86c3-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-f9ee0f29-418a-4c2f-add9-840eb1ac86c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5613a06d-1f0d-451c-a669-d1e28ad68b71]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.293s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:31 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972" returned: 0 in 0.393s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 is being set with open permissions: ugo+rw Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:31 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 Jul 14 20:34:31 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 Jul 14 20:34:31 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-55934b12-d14c-4eff-b8d2-3f5c7d545d4d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-879bb18a-75be-41db-9084-2b5a1d93829e-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:31 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972" returned: 0 in 0.263s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" returned: 0 in 0.373s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3 Jul 14 20:34:31 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info Jul 14 20:34:31 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" returned: 0 in 0.240s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-f9ee0f29-418a-4c2f-add9-840eb1ac86c3" released by "delete_volume" :: held 0.652s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:31 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info is being set with open permissions: ugo+rw Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info Jul 14 20:34:31 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['b663cad9-a5e6-4c73-98cd-4d8edd12a2e2', 'efad0e8c-3da0-48b8-a218-d4ce0fb02115', '6aa0c3c7-bd91-4caa-a578-6783c5afd383', '1f28c85a-cb21-43f8-b107-1561933db8c1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:31 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:31 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:31 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.info" returned: 0 in 0.270s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85bd066b-2ccc-4cf7-9afc-58029bb4ca4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d419a42a7643ad85bd1f097df97fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:29Z,use_quota=True,user_id='3eaa05fa9f0a40bc9cdd7d9172e102d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Creating volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:31 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1073741824 Jul 14 20:34:32 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a0a1938e-f0d6-45f4-bcdd-1caa047ea6fa tempest-ProjectReaderTests-1124851849 None] Create snapshot completed successfully Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-2344625a-ee59-4fa4-bb7b-804ff890ba7b-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:32 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-2344625a-ee59-4fa4-bb7b-804ff890ba7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:32 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5c878e30-257f-44bc-bdeb-9e2fb2ca0b5d tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-f9ee0f29-418a-4c2f-add9-840eb1ac86c3-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-2344625a-ee59-4fa4-bb7b-804ff890ba7b" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-2344625a-ee59-4fa4-bb7b-804ff890ba7b" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc631a6-3f4c-4de9-9d2a-c165c5b955c9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b Jul 14 20:34:32 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1073741824" returned: 0 in 0.437s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:32 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b" returned: 0 in 0.362s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b Jul 14 20:34:32 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.836s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Creating offline snapshot bfae7a98-caff-48a0-ad3e-ead77729417a of volume c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Attempting download of d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 ((None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}])) to volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32efdb6-8f38-48ae-a8fe-fe9be16b52a7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f26b5-7706-4cbf-9b47-c080fe781b3b]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:32 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2344625a-ee59-4fa4-bb7b-804ff890ba7b" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-2344625a-ee59-4fa4-bb7b-804ff890ba7b" released by "delete_volume" :: held 0.669s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:32 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf Jul 14 20:34:32 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c Jul 14 20:34:32 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:32 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['9ba14622-ce50-4a46-8c20-2911cd5f065d', 'd9578ba6-60e0-4c7c-bea2-b69751ec75cd', 'd8008128-a69a-4cc6-89cf-7ddb7c1f188b', 'ddf8deef-0ecd-42e1-a794-a8270b426d22'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:33 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf" returned: 0 in 0.414s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a 1G Jul 14 20:34:33 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-6a11c769-b530-4ad1-b629-2c84c12fc972-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-6a11c769-b530-4ad1-b629-2c84c12fc972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:33 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c" returned: 0 in 0.474s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-6a11c769-b530-4ad1-b629-2c84c12fc972" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6a11c769-b530-4ad1-b629-2c84c12fc972" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Deleting offline snapshot 6a11c769-b530-4ad1-b629-2c84c12fc972 of volume 14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] snapshot_file for this snap is: volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:33 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5da74-dd25-4d13-b76b-2003b091e116]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.392s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:33 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c Jul 14 20:34:33 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c67060cb-6a1b-4c05-bc28-104a6f8c9954 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-2344625a-ee59-4fa4-bb7b-804ff890ba7b-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[05decf57-edac-408f-87a5-18faf8b65e91]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 Jul 14 20:34:33 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c" returned: 1 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_zdxode2c' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd526bf-ffcc-47d2-b949-29ceed13d52c]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c Jul 14 20:34:33 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a 1G" returned: 0 in 0.588s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a Jul 14 20:34:33 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:33 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:33 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972" returned: 0 in 0.524s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:33 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" returned: 0 in 0.421s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b6f602-239a-4747-878e-4d3f3a16dded]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:33 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c Jul 14 20:34:33 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e Jul 14 20:34:34 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a" returned: 0 in 0.370s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a is being set with open permissions: ugo+rw Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a Jul 14 20:34:34 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD Jul 14 20:34:34 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c" released by "delete_volume" :: held 0.783s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:34 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 Jul 14 20:34:34 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['1278a46f-4e66-4048-a6c3-72a7ecdeace6', '364a0464-687b-4d54-a44f-c2c4c00d0ba2', '3691ed94-171e-4b94-ac27-50eb25b2b430', '3e8e959e-2a1e-4d0b-a7e9-fa18ab4aa416'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:34 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a" returned: 0 in 0.304s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:34 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 was raw, converting to raw {{(pid=87600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info Jul 14 20:34:34 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-806d3f34-5163-44b4-aa61-60d17efc47b8-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:34 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:34 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-806d3f34-5163-44b4-aa61-60d17efc47b8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "cinder-quobyte-806d3f34-5163-44b4-aa61-60d17efc47b8" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-806d3f34-5163-44b4-aa61-60d17efc47b8" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed3c900-0acc-4ac4-8a3a-7f636b5345bb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:34 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972" returned: 0 in 0.466s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972 Jul 14 20:34:34 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ad190168-f3a5-4e4d-a1b8-dae4ce8e4ce1 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-21b0c9fb-9c4d-42df-b4b3-3e5b86e0097c-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:34 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 Jul 14 20:34:34 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:34 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info" returned: 0 in 0.416s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:34 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info is being set with open permissions: ugo+rw Jul 14 20:34:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:34 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info Jul 14 20:34:34 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 0 in 0.484s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d09c6e31-8e8f-4225-9d9b-1bdcf40bb348_scuxunpxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:34:35 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1G Jul 14 20:34:35 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e.6a11c769-b530-4ad1-b629-2c84c12fc972" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6a11c769-b530-4ad1-b629-2c84c12fc972" released by "_delete_snapshot" :: held 1.792s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" released by "delete_snapshot" :: held 1.842s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:35 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8" returned: 0 in 0.452s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8 Jul 14 20:34:35 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Created reservations ['72c77df7-2bb0-418a-b5b6-1c784a2e851e', '270a8700-8edc-43f9-a34e-d464adc2517b', '54eaf939-c037-48ed-b5d0-f02c2c49e9fa', 'aba55601-3ada-4035-be20-e17f70cac3c1'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:35 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.info" returned: 0 in 0.324s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4d6c61ea-819a-4859-81bd-7740d772e14c tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:34:35 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Delete snapshot completed successfully. Jul 14 20:34:35 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f 1G" returned: 0 in 0.316s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c4f343fb-0b87-41bb-9fd6-9e635bd2f308 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-6a11c769-b530-4ad1-b629-2c84c12fc972-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349b86c-2dcc-49f5-944f-b8da7e87ba99]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:35 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-806d3f34-5163-44b4-aa61-60d17efc47b8" returned: 0 in 0.311s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:35 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-quobyte-806d3f34-5163-44b4-aa61-60d17efc47b8" released by "delete_volume" :: held 0.822s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Created reservations ['80077d36-84e9-4747-9e13-d6f992d73974', '05f8736a-21cd-4230-9add-b787fcb16b73', '6e8fef16-1beb-4cb7-80df-70a33543ed92', '647c28c6-0796-4b2d-909c-c0b8abdb0797'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[90714b96-3df3-4e82-9973-9710e80dba40]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:35 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e Jul 14 20:34:35 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:35 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 0 in 0.396s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:35 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:35 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:36 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.323s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Deleted volume successfully. Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c3e8fbd4-397b-4e44-81ca-3616728a72e2 tempest-CreateVolumesFromSourceVolumeTest-1828979318 None] Lock "cinder-806d3f34-5163-44b4-aa61-60d17efc47b8-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:36 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" returned: 0 in 0.477s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:36 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e Jul 14 20:34:36 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-bfae7a98-caff-48a0-ad3e-ead77729417a-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-bfae7a98-caff-48a0-ad3e-ead77729417a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-bfae7a98-caff-48a0-ad3e-ead77729417a" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-bfae7a98-caff-48a0-ad3e-ead77729417a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot bfae7a98-caff-48a0-ad3e-ead77729417a of volume c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:36 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 1 in 0.494s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Downloaded image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 ((None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}])) to volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f successfully. {{(pid=87600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Temporary image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 for user 3eaa05fa9f0a40bc9cdd7d9172e102d4 is deleted. {{(pid=87600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.volume_utils [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Marking volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f as bootable. {{(pid=87600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe00e6c-2727-4f38-bad9-33f5643fd453]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Copying metadata from image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 to 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f. {{(pid=87600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Creating volume glance metadata for volume 85bd066b-2ccc-4cf7-9afc-58029bb4ca4f backed by image d09c6e31-8e8f-4225-9d9b-1bdcf40bb348 with: {'image_id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9ddf4b1bf616c0b3c32a5ac186d1c134', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 20:34:36 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a Jul 14 20:34:36 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:36 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62007a0-0ec9-430d-b367-aebf6afd36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f', 'volume_size': 1, 'image_id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ddf4b1bf616c0b3c32a5ac186d1c134', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d419a42a7643ad85bd1f097df97fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416845c6079f61ae4c8cdc6788a98d889d5d2217d3dff7f4f47a25ada984cf30c4dd39196c370eda015fc404e785379c1a13c7cbe006157edc996696e37a5924', 'id': 'd09c6e31-8e8f-4225-9d9b-1bdcf40bb348', 'created_at': datetime.datetime(2026, 7, 14, 18, 34, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 18, 34, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09c6e31-8e8f-4225-9d9b-1bdcf40bb348/file', 'properties': {}}, 'image_service': }' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1eed4-10a6-4bf4-8175-a067554f9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Volume volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f (85bd066b-2ccc-4cf7-9afc-58029bb4ca4f): created successfully Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1eed4-10a6-4bf4-8175-a067554f9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Flow 'volume_create_manager' (b034ad6c-662c-49c8-a44a-18ff23ab4de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e" released by "delete_volume" :: held 0.947s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e4a1f975-004f-4ad9-b61f-3f02d8f74d12 tempest-VolumeImageDependencyTests-796572480 None] Created volume successfully. Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Created reservations ['58668788-d75a-477f-8591-b920d3f96648', 'c2abf320-9a7f-47fa-81af-fac825c4b841', '9da3dfc0-fa8f-4ab0-bb48-d59e7a174351', '7811e7b5-5860-4fc5-9149-0ef2d45df68b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:36 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:36 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:36 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a" returned: 0 in 0.491s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff338f9a-dc26-4ae5-87ad-3c47a796773d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:36 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf Jul 14 20:34:36 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:36 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:36 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Deleted volume successfully. Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a2a0f1b7-0af7-4c7e-8e6a-9203a55f9bb8 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-14af0bfe-7e47-4b65-8fc5-da2aa9ca191e-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:37 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:37 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a Jul 14 20:34:37 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Acquiring lock "cinder-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "cinder-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Acquiring lock "cinder-quobyte-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "cinder-quobyte-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:37 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d937071-da1d-4b68-8a4d-a54784d9cfca]: (4, 'raw') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:37 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a Jul 14 20:34:37 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:37 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:37 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:38 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf.bfae7a98-caff-48a0-ad3e-ead77729417a" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-bfae7a98-caff-48a0-ad3e-ead77729417a" released by "_delete_snapshot" :: held 1.859s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" released by "delete_snapshot" :: held 1.895s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:38 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 0 in 0.502s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Created reservations ['84753717-4c1f-4681-a836-896944cd5ecf', 'd4f63458-4d95-439d-86da-72d2b002c72c', '154da565-d1ad-406a-9af3-bf07e528aa7d', 'f3296b31-6cc5-4ac6-b68a-ec2a6d677e69'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (333b7da7-49fe-4b28-8c69-8a7acf487ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08954dd-1bef-4e8c-9b44-80d70a1c75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08954dd-1bef-4e8c-9b44-80d70a1c75d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817274460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae35bf-6564-4e6f-a052-360b93f04073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:38Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:38 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9577423d-1672-40c5-b76d-3d66ffb66036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:38 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9577423d-1672-40c5-b76d-3d66ffb66036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b00bdd-40a5-43e0-a3c8-32a8318f17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b00bdd-40a5-43e0-a3c8-32a8318f17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dae35bf-6564-4e6f-a052-360b93f04073', 'volume_name': 'volume-2dae35bf-6564-4e6f-a052-360b93f04073', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9e5169-81e4-440a-a48c-d01a5fa30f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9e5169-81e4-440a-a48c-d01a5fa30f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67c118e-3d4a-460c-b818-16357aa575c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:38 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Volume 2dae35bf-6564-4e6f-a052-360b93f04073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dae35bf-6564-4e6f-a052-360b93f04073', 'volume_size': 1} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817274460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae35bf-6564-4e6f-a052-360b93f04073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:38Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Creating volume 2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:38 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:38 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 1073741824 Jul 14 20:34:38 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:38 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b3c71fa2-5524-4eba-aada-c78af09bf07f tempest-ProjectMemberTests-646539804 None] Lock "cinder-bfae7a98-caff-48a0-ad3e-ead77729417a-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:38 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 1 in 0.373s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f' failed. Not Retrying. {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:38 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f Jul 14 20:34:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "cinder-quobyte-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f" released by "delete_volume" :: held 1.242s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:38 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 1073741824" returned: 0 in 0.549s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Created reservations ['b49b37af-aabf-4ed1-a781-5b45c8dc9062', '894c54a2-03cf-4987-ab2d-76319117e284', 'cf555144-dccc-4bb2-a910-069b4913875b', 'e84c131a-0363-4ca9-87b4-955bdb5a9849'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:38 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 Jul 14 20:34:38 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:39 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:39 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:39 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67c118e-3d4a-460c-b818-16357aa575c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dae35bf-6564-4e6f-a052-360b93f04073', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d475971b-4b30-4b04-879a-2e4a1173f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:39 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Volume volume-2dae35bf-6564-4e6f-a052-360b93f04073 (2dae35bf-6564-4e6f-a052-360b93f04073): created successfully Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d475971b-4b30-4b04-879a-2e4a1173f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (333b7da7-49fe-4b28-8c69-8a7acf487ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1b51074b-c08c-450f-aad9-f0cba6bf92eb tempest-ProjectReaderTests-1124851849 None] Created volume successfully. Jul 14 20:34:39 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.305s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Deleted volume successfully. Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2e9a75df-b07f-46ef-8291-34bfa8ae2af1 tempest-VolumeImageDependencyTests-796572480 None] Lock "cinder-85bd066b-2ccc-4cf7-9afc-58029bb4ca4f-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-c7511422-3d7e-4ff0-9b28-106e5df75bdf-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "cinder-c7511422-3d7e-4ff0-9b28-106e5df75bdf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a508e0eb-a5ce-4001-9a02-8ef034f252d9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:39 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf Jul 14 20:34:39 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:39 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf" returned: 0 in 0.418s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:39 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf Jul 14 20:34:39 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:40 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-c7511422-3d7e-4ff0-9b28-106e5df75bdf" returned: 0 in 0.278s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c7511422-3d7e-4ff0-9b28-106e5df75bdf" released by "delete_volume" :: held 0.769s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Created reservations ['3ce60e24-6124-4ce3-a182-d3588f9d1915', 'e6e493de-5be3-4b63-a799-a40ce46b27e3', '8d3f1a1f-3f1a-409c-93ac-5f85802cabdd', 'a629b321-09cf-4a9e-9748-3115cd461cdd'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:40 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:40 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Creating offline snapshot f6e576b1-e603-4650-80a7-147bad94dfd8 of volume 2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb608234-2a0c-49d8-941a-facac73040a8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:40 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 Jul 14 20:34:40 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:40 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.473s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:34:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8d5c277e-130d-4e47-a5e6-cac259b08d7e tempest-ProjectMemberTests-646539804 None] Lock "cinder-c7511422-3d7e-4ff0-9b28-106e5df75bdf-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:41 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073" returned: 0 in 0.570s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:41 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 1G Jul 14 20:34:41 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (2d3530c0-1373-4704-b4f8-6303464b9b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bac0942-d74e-4694-ba91-e0f3e93cc1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bac0942-d74e-4694-ba91-e0f3e93cc1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607019884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5855b0-84ee-4554-87b8-f87c3753d97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:41Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad6cdfc-0c50-43a7-a9c5-6f92e0e66f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad6cdfc-0c50-43a7-a9c5-6f92e0e66f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478d6fc1-0fa5-45a3-92c7-5407f7139ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478d6fc1-0fa5-45a3-92c7-5407f7139ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5855b0-84ee-4554-87b8-f87c3753d97a', 'volume_name': 'volume-ef5855b0-84ee-4554-87b8-f87c3753d97a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a1982-3d5e-4955-95cf-873c8cd57719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a1982-3d5e-4955-95cf-873c8cd57719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850feec9-8a1a-4db9-9195-95e8edfc7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:41 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Volume ef5855b0-84ee-4554-87b8-f87c3753d97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5855b0-84ee-4554-87b8-f87c3753d97a', 'volume_size': 1} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:41 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 1G" returned: 0 in 0.608s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dae35bf-6564-4e6f-a052-360b93f04073 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:41 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dae35bf-6564-4e6f-a052-360b93f04073 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 Jul 14 20:34:41 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:42 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dae35bf-6564-4e6f-a052-360b93f04073 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8" returned: 0 in 0.353s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:42 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 is being set with open permissions: ugo+rw Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:42 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 Jul 14 20:34:42 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:42 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:42 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info Jul 14 20:34:42 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:42 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:42 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info is being set with open permissions: ugo+rw Jul 14 20:34:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:42 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info Jul 14 20:34:42 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:43 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.info" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607019884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5855b0-84ee-4554-87b8-f87c3753d97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:41Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Creating volume ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:43 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:43 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a 1073741824 Jul 14 20:34:43 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f6570084-cd61-4df4-9ac1-dd1b543e50f7 tempest-ProjectReaderTests-1124851849 None] Create snapshot completed successfully Jul 14 20:34:43 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a 1073741824" returned: 0 in 0.554s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-f6e576b1-e603-4650-80a7-147bad94dfd8-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:43 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a Jul 14 20:34:43 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-f6e576b1-e603-4650-80a7-147bad94dfd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-f6e576b1-e603-4650-80a7-147bad94dfd8" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-f6e576b1-e603-4650-80a7-147bad94dfd8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Deleting offline snapshot f6e576b1-e603-4650-80a7-147bad94dfd8 of volume 2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] snapshot_file for this snap is: volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eeda56-c064-4285-8a27-374247bc09de]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Flow 'volume_create_manager' (87476a0b-3efc-48b3-990c-b69423076f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c13457-a88d-4865-ad84-7da2913c3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c13457-a88d-4865-ad84-7da2913c3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07283dae-86f2-459c-ad46-12b86b698d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc234e9f58cb415a95b00223e0422449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:44Z,use_quota=True,user_id='ea86075643964ab79518b3c9faf333bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd14303-9c94-477e-8d0b-d0edb263c03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd14303-9c94-477e-8d0b-d0edb263c03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bcd82c-500e-4a79-9165-e1a4cb2743fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bcd82c-500e-4a79-9165-e1a4cb2743fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07283dae-86f2-459c-ad46-12b86b698d67', 'volume_name': 'volume-07283dae-86f2-459c-ad46-12b86b698d67', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fce8b2-a75b-457b-91c6-f4adebc8c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fce8b2-a75b-457b-91c6-f4adebc8c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4e0753-97c0-48ac-99de-66d1f2117428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Volume 07283dae-86f2-459c-ad46-12b86b698d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07283dae-86f2-459c-ad46-12b86b698d67', 'volume_size': 1} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:44 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 Jul 14 20:34:44 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:44 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a" returned: 0 in 0.312s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07283dae-86f2-459c-ad46-12b86b698d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc234e9f58cb415a95b00223e0422449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:44Z,use_quota=True,user_id='ea86075643964ab79518b3c9faf333bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Creating volume 07283dae-86f2-459c-ad46-12b86b698d67 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:44 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850feec9-8a1a-4db9-9195-95e8edfc7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5855b0-84ee-4554-87b8-f87c3753d97a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc63c1c-bfb6-4dd5-9326-5246d8b919bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:44 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 1073741824 Jul 14 20:34:44 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:44 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Volume volume-ef5855b0-84ee-4554-87b8-f87c3753d97a (ef5855b0-84ee-4554-87b8-f87c3753d97a): created successfully Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc63c1c-bfb6-4dd5-9326-5246d8b919bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (2d3530c0-1373-4704-b4f8-6303464b9b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c36ab347-3e0e-442c-9227-7799102e8b96 tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:34:44 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8" returned: 0 in 0.409s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dae35bf-6564-4e6f-a052-360b93f04073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5822697-42d5-4d29-9631-5259e521b2d9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:44 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 Jul 14 20:34:44 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:44 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 1073741824" returned: 0 in 0.586s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=224,cinder:UPDATE=311,cinder:DELETE=33,cinder:INSERT=81 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=236,cinder:UPDATE=308,cinder:INSERT=85,cinder:DELETE=23 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:44 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 Jul 14 20:34:44 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:44 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073" returned: 0 in 0.516s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:44 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 Jul 14 20:34:44 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:45 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.274s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Creating offline snapshot 2affd048-d3a2-46b2-8bef-8b2f11a23e5e of volume ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4e0753-97c0-48ac-99de-66d1f2117428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07283dae-86f2-459c-ad46-12b86b698d67', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db97bf9-f82a-4da9-8504-686eb6f41f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a988194-a9ad-419d-a31d-fdb8aabe25e1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Volume volume-07283dae-86f2-459c-ad46-12b86b698d67 (07283dae-86f2-459c-ad46-12b86b698d67): created successfully Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db97bf9-f82a-4da9-8504-686eb6f41f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Flow 'volume_create_manager' (87476a0b-3efc-48b3-990c-b69423076f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fbf50d48-756d-4005-bd68-98ae781a8a40 tempest-CinderUnicodeTest-1765200462 None] Created volume successfully. Jul 14 20:34:45 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a Jul 14 20:34:45 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:45 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:45 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8 Jul 14 20:34:45 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:45 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:45 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:45 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e 1G Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073.f6e576b1-e603-4650-80a7-147bad94dfd8" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:45 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-f6e576b1-e603-4650-80a7-147bad94dfd8" released by "_delete_snapshot" :: held 1.664s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" released by "delete_snapshot" :: held 1.706s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Created reservations ['8fc7efa6-c4de-4025-918e-f158f592e696', '744c58b0-571f-4aca-b4ac-a1a1d6a74d4b', 'f7e6d0f2-829a-43b3-8a96-09ea834cd651', 'e97203f6-1407-4dfb-a0f6-b00d9743537f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Delete snapshot completed successfully. Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-50da1846-f762-42ff-a64e-18d5bc740af4 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-f6e576b1-e603-4650-80a7-147bad94dfd8-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:45 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e 1G" returned: 0 in 0.448s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5855b0-84ee-4554-87b8-f87c3753d97a -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:45 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-2dae35bf-6564-4e6f-a052-360b93f04073-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:46 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5855b0-84ee-4554-87b8-f87c3753d97a -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e Jul 14 20:34:46 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "cinder-2dae35bf-6564-4e6f-a052-360b93f04073-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c52f84-87eb-4cf3-a790-d9e8a4c7ae21]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:46 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 Jul 14 20:34:46 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:46 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5855b0-84ee-4554-87b8-f87c3753d97a -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e" returned: 0 in 0.434s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:46 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e is being set with open permissions: ugo+rw Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:46 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e Jul 14 20:34:46 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:46 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Flow 'volume_create_manager' (1df3b30a-4395-4f51-ad25-6c86d1dfc612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3835cf0-4a92-4547-9af1-dcab99b17f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:46 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073" returned: 0 in 0.569s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e" returned: 0 in 0.321s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:46 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073 Jul 14 20:34:46 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3835cf0-4a92-4547-9af1-dcab99b17f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2123326890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d081819-2b23-4f0f-a087-4729ae797078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc234e9f58cb415a95b00223e0422449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:47Z,use_quota=True,user_id='ea86075643964ab79518b3c9faf333bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac1157a-70c9-4680-905d-8480e10d6d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac1157a-70c9-4680-905d-8480e10d6d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecbf62c-7a0b-4d45-8651-779b323d3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecbf62c-7a0b-4d45-8651-779b323d3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d081819-2b23-4f0f-a087-4729ae797078', 'volume_name': 'volume-5d081819-2b23-4f0f-a087-4729ae797078', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db16fe1-e123-4d3e-95e5-2fb8884d2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db16fe1-e123-4d3e-95e5-2fb8884d2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1936c16-44d9-4530-a1e6-3876858b27e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:46 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Volume 5d081819-2b23-4f0f-a087-4729ae797078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d081819-2b23-4f0f-a087-4729ae797078', 'volume_size': 1} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:46 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:46 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info Jul 14 20:34:46 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:47 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2dae35bf-6564-4e6f-a052-360b93f04073" returned: 0 in 0.300s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-2dae35bf-6564-4e6f-a052-360b93f04073" released by "delete_volume" :: held 0.949s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Created reservations ['d619e32e-a931-4101-9eac-c02dc345838d', 'd2221e3e-f25f-40d4-9a41-dfe8ce986fc7', 'f36fc071-3b61-4cb5-846e-bd28406a0d56', '12449ae0-e60f-4533-b586-011387609095'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:47 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info" returned: 0 in 0.311s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:47 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info is being set with open permissions: ugo+rw Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:47 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info Jul 14 20:34:47 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:47 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:47 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:47 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.info" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2123326890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d081819-2b23-4f0f-a087-4729ae797078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc234e9f58cb415a95b00223e0422449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:47Z,use_quota=True,user_id='ea86075643964ab79518b3c9faf333bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Creating volume 5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:47 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:47 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 1073741824 Jul 14 20:34:47 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:47 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-58ec125a-305c-49c7-81bf-0d7ce5db38e7 tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:34:47 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:47 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Deleted volume successfully. Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-9f290a13-a978-421a-b2e5-eb38dab7699f tempest-ProjectReaderTests-1124851849 None] Lock "cinder-2dae35bf-6564-4e6f-a052-360b93f04073-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:47 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 1073741824" returned: 0 in 0.466s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:47 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 Jul 14 20:34:47 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-2affd048-d3a2-46b2-8bef-8b2f11a23e5e-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-2affd048-d3a2-46b2-8bef-8b2f11a23e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-2affd048-d3a2-46b2-8bef-8b2f11a23e5e" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2affd048-d3a2-46b2-8bef-8b2f11a23e5e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot 2affd048-d3a2-46b2-8bef-8b2f11a23e5e of volume ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88d4da-3be9-490e-99f4-a378de1bc3a3]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:48 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078" returned: 0 in 0.286s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1936c16-44d9-4530-a1e6-3876858b27e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d081819-2b23-4f0f-a087-4729ae797078', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e615702-b702-4a5b-afae-ac536a6edbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Volume volume-5d081819-2b23-4f0f-a087-4729ae797078 (5d081819-2b23-4f0f-a087-4729ae797078): created successfully Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e615702-b702-4a5b-afae-ac536a6edbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Flow 'volume_create_manager' (1df3b30a-4395-4f51-ad25-6c86d1dfc612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:48 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e Jul 14 20:34:48 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7cf9868f-c90c-4f43-93ba-b70505089316 tempest-CinderUnicodeTest-1765200462 None] Created volume successfully. Jul 14 20:34:48 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e" returned: 0 in 0.458s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5855b0-84ee-4554-87b8-f87c3753d97a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ec5e9-82a8-4adb-83f5-877e30628cdb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:48 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a Jul 14 20:34:48 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (e0e310ce-89c4-4b22-b6aa-ca0933920618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f838486-6561-48be-aba5-cbed0448af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f838486-6561-48be-aba5-cbed0448af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587269040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb5982-a47f-49c1-b09e-c0ba35db09c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:49Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af7d79-a159-48b4-abb2-a4ee8488d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af7d79-a159-48b4-abb2-a4ee8488d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545f0617-5a0d-453c-87d4-8dab673fef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545f0617-5a0d-453c-87d4-8dab673fef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fb5982-a47f-49c1-b09e-c0ba35db09c3', 'volume_name': 'volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197cb7e2-8630-4d09-ac59-032685d62050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197cb7e2-8630-4d09-ac59-032685d62050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a369f8-2e0e-4e48-a22a-64fc7c36a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Volume 94fb5982-a47f-49c1-b09e-c0ba35db09c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3', 'volume_size': 1} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587269040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb5982-a47f-49c1-b09e-c0ba35db09c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:49Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Creating volume 94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:48 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:49 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 1073741824 Jul 14 20:34:49 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:49 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a" returned: 0 in 0.462s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:49 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e Jul 14 20:34:49 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:49 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 1073741824" returned: 0 in 0.489s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:49 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:49 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e Jul 14 20:34:49 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:49 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 Jul 14 20:34:49 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:49 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a.2affd048-d3a2-46b2-8bef-8b2f11a23e5e" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:49 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3" returned: 0 in 0.269s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2affd048-d3a2-46b2-8bef-8b2f11a23e5e" released by "_delete_snapshot" :: held 1.701s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.522s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" released by "delete_snapshot" :: held 1.738s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a369f8-2e0e-4e48-a22a-64fc7c36a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54af8fb5-98ae-4f3f-acd6-fa5a8e52c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Creating offline snapshot 44688f2f-8103-4afb-960b-dde31bb462f1 of volume 5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Volume volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 (94fb5982-a47f-49c1-b09e-c0ba35db09c3): created successfully Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54af8fb5-98ae-4f3f-acd6-fa5a8e52c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (e0e310ce-89c4-4b22-b6aa-ca0933920618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe266cad-ff9d-47eb-84ba-3c504a955f53]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3a78409a-cf1f-4931-a8d4-a61f68b850b6 tempest-ProjectReaderTests-1124851849 None] Created volume successfully. Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Created reservations ['d76ee75d-2fa8-4517-a78b-5e5fb2865394', 'b18e4757-ef53-4c5a-a8e9-b98915924489', '35f0aeb5-8538-4e9a-b12b-f1cd427eae83', '4f0c3b6d-a7af-404e-9bc0-9e49ae3d9533'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:49 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 Jul 14 20:34:49 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:34:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-54b38477-8276-4e24-bdfe-485bd3e47820 tempest-ProjectMemberTests-646539804 None] Lock "cinder-2affd048-d3a2-46b2-8bef-8b2f11a23e5e-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-ef5855b0-84ee-4554-87b8-f87c3753d97a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "cinder-ef5855b0-84ee-4554-87b8-f87c3753d97a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:50 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078" returned: 0 in 0.406s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:50 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 1G Jul 14 20:34:50 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb49224-39b9-4126-acaa-f51cfae9574e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:50 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a Jul 14 20:34:50 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:50 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 1G" returned: 0 in 0.462s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d081819-2b23-4f0f-a087-4729ae797078 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:50 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a" returned: 0 in 0.410s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:50 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d081819-2b23-4f0f-a087-4729ae797078 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 Jul 14 20:34:50 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:50 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a Jul 14 20:34:50 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:51 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef5855b0-84ee-4554-87b8-f87c3753d97a" returned: 0 in 0.317s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:51 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d081819-2b23-4f0f-a087-4729ae797078 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:51 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 is being set with open permissions: ugo+rw Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef5855b0-84ee-4554-87b8-f87c3753d97a" released by "delete_volume" :: held 0.805s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:51 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 Jul 14 20:34:51 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Created reservations ['5a12ef88-d293-4338-80db-1d43d4437c06', '9aee63af-3306-4317-b8ca-5ab8fae4d660', '3f46c62b-b89e-42fa-9a15-9a5c2c2e4ce9', '4d1c36b9-567c-4000-a1a8-a77aa97614c3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:51 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:51 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:51 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1" returned: 0 in 0.317s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:51 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info Jul 14 20:34:51 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:51 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.282s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:51 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-25923657-668d-4fe5-ab31-081486472f0a tempest-ProjectMemberTests-646539804 None] Lock "cinder-ef5855b0-84ee-4554-87b8-f87c3753d97a-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:51 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info" returned: 0 in 0.355s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:51 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info is being set with open permissions: ugo+rw Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:51 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info Jul 14 20:34:51 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (7e0bd596-c0c7-43c2-874b-665b58472bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3269f4f-de58-4356-8b82-8cc580cfc046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3269f4f-de58-4356-8b82-8cc580cfc046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123164921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:52Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:51 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f97e74-b8bc-46b3-8672-8cc1ae3cdb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f97e74-b8bc-46b3-8672-8cc1ae3cdb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982943a0-8691-454c-b53a-ca3a7bae06a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982943a0-8691-454c-b53a-ca3a7bae06a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c', 'volume_name': 'volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fef19b1-357e-4dd4-9313-ab3dd7e42b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fef19b1-357e-4dd4-9313-ab3dd7e42b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f8d9b-2450-4d3c-8efe-108723239e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:52 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Volume fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c', 'volume_size': 1} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:52 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.info" returned: 0 in 0.290s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.988s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Creating offline snapshot e70b9b9a-9946-41f7-84c6-93ed2e433275 of volume 94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:52 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ad996cee-73ba-49e4-bce3-417d91dff13e tempest-CinderUnicodeTest-1765200462 None] Create snapshot completed successfully Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41eb1fc-13f8-4dde-91ef-db1db3910971]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:52 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 Jul 14 20:34:52 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:52 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:52 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:52 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 1G Jul 14 20:34:52 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 1G" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 Jul 14 20:34:53 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-44688f2f-8103-4afb-960b-dde31bb462f1-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-44688f2f-8103-4afb-960b-dde31bb462f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:53 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-quobyte-44688f2f-8103-4afb-960b-dde31bb462f1" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275" returned: 0 in 0.321s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 is being set with open permissions: ugo+rw Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-44688f2f-8103-4afb-960b-dde31bb462f1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:53 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 Jul 14 20:34:53 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Deleting offline snapshot 44688f2f-8103-4afb-960b-dde31bb462f1 of volume 5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] snapshot_file for this snap is: volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ad42b-3fa1-4d73-82f4-510ec3d219c7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 Jul 14 20:34:53 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:53 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info Jul 14 20:34:53 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:53 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1" returned: 0 in 0.413s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d081819-2b23-4f0f-a087-4729ae797078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39ee4d7-bd90-4bae-8bc6-9829eda8cdb2]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info" returned: 0 in 0.307s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:53 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info is being set with open permissions: ugo+rw Jul 14 20:34:53 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:53 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info Jul 14 20:34:53 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 Jul 14 20:34:54 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.info" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123164921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:52Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Creating volume fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:54 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:54 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:54 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c 1073741824 Jul 14 20:34:54 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078" returned: 0 in 0.428s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:54 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a67353af-e692-4d80-86c2-9715a24bf2a0 tempest-ProjectReaderTests-1124851849 None] Create snapshot completed successfully Jul 14 20:34:54 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 Jul 14 20:34:54 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Flow 'volume_create_manager' (771f7d57-9300-431d-983b-0229b34f822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ccd1c4-7a73-4313-b50e-61e3e67abe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ccd1c4-7a73-4313-b50e-61e3e67abe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952528137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d02f1b-6a92-4eb3-ba2a-a264f8e3068c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaaa7da0a3f343bc95403027bc149a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:54Z,use_quota=True,user_id='8d6269661b0a42708c286bb366b770fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7031dfb4-37fb-4f6e-bce4-087607190a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7031dfb4-37fb-4f6e-bce4-087607190a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45062e4d-5d65-49e1-bd6a-f5713528e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45062e4d-5d65-49e1-bd6a-f5713528e949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d02f1b-6a92-4eb3-ba2a-a264f8e3068c', 'volume_name': 'volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c1da1-72b3-4895-bde1-67c635f367c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c1da1-72b3-4895-bde1-67c635f367c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13569f6-6c1f-42ca-ae47-4d2bd365fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:54 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Volume 76d02f1b-6a92-4eb3-ba2a-a264f8e3068c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c', 'volume_size': 1} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:54 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:54 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1" returned: 0 in 0.424s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c 1073741824" returned: 0 in 0.486s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:54 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1 Jul 14 20:34:54 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:54 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c Jul 14 20:34:54 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:54 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:54 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078.44688f2f-8103-4afb-960b-dde31bb462f1" returned: 0 in 0.242s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-44688f2f-8103-4afb-960b-dde31bb462f1" released by "_delete_snapshot" :: held 1.633s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" released by "delete_snapshot" :: held 1.668s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:55 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952528137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d02f1b-6a92-4eb3-ba2a-a264f8e3068c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaaa7da0a3f343bc95403027bc149a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:54Z,use_quota=True,user_id='8d6269661b0a42708c286bb366b770fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Creating volume 76d02f1b-6a92-4eb3-ba2a-a264f8e3068c {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f8d9b-2450-4d3c-8efe-108723239e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:55 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c 1073741824 Jul 14 20:34:55 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201bb171-0cdc-465c-8ec6-197c25b27ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Volume volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c (fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c): created successfully Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201bb171-0cdc-465c-8ec6-197c25b27ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (7e0bd596-c0c7-43c2-874b-665b58472bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1d8a895c-ea1a-4282-8cb4-44f260a75ba6 tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Created reservations ['484a8922-db3e-4b1a-ad59-6551728450f4', 'e8d98ae8-c211-4ba3-a869-5b80c62c356f', '7428e4c8-396c-4812-8d97-e95f15706606', 'cf715211-9599-43ea-831c-ca77cdef4322'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Delete snapshot completed successfully. Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-415f383d-e1da-4bad-9a21-80a779e98cbf tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-44688f2f-8103-4afb-960b-dde31bb462f1-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-e70b9b9a-9946-41f7-84c6-93ed2e433275-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-e70b9b9a-9946-41f7-84c6-93ed2e433275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-e70b9b9a-9946-41f7-84c6-93ed2e433275" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-e70b9b9a-9946-41f7-84c6-93ed2e433275" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Deleting offline snapshot e70b9b9a-9946-41f7-84c6-93ed2e433275 of volume 94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] snapshot_file for this snap is: volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8373f952-ed35-4ba0-bf79-730cff5e3db8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-5d081819-2b23-4f0f-a087-4729ae797078-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:55 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 Jul 14 20:34:55 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-5d081819-2b23-4f0f-a087-4729ae797078-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:55 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c 1073741824" returned: 0 in 0.505s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[376694f1-af94-4201-b0db-b8bf91c8b0c5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:55 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c Jul 14 20:34:55 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:55 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 Jul 14 20:34:55 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:55 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78ad3b-83ab-4f1a-80b6-122670a385b5]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:55 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" returned: 0 in 0.281s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13569f6-6c1f-42ca-ae47-4d2bd365fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaabf723-5cde-45de-a38e-77d545b2f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:55 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 Jul 14 20:34:55 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Volume volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c (76d02f1b-6a92-4eb3-ba2a-a264f8e3068c): created successfully Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaabf723-5cde-45de-a38e-77d545b2f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:55 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Flow 'volume_create_manager' (771f7d57-9300-431d-983b-0229b34f822c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:55 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-506f0edc-501e-455c-9ec7-729b4a64aaef tempest-ProjectReaderTests-839359662 None] Created volume successfully. Jul 14 20:34:56 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078" returned: 0 in 0.411s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078 Jul 14 20:34:56 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3" returned: 0 in 0.402s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 Jul 14 20:34:56 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Creating offline snapshot c8c4beff-9a22-4f48-a3bb-6fbb80a2278e of volume fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:34:56 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-5d081819-2b23-4f0f-a087-4729ae797078" returned: 0 in 0.286s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0386f-003a-4e01-aef6-24752d52238d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-5d081819-2b23-4f0f-a087-4729ae797078" released by "delete_volume" :: held 0.791s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Created reservations ['245f35a1-7a5e-4a54-9986-d1b1e20eac98', '0318ecf2-7024-47dc-9ed6-631e65103056', 'e7c561f6-1b73-453e-95bd-b9eb40781540', 'f33920c9-1f26-4be1-9262-a0ccf6f09aa3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:56 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c Jul 14 20:34:56 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:56 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275" returned: 0 in 0.450s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275 Jul 14 20:34:56 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-07283dae-86f2-459c-ad46-12b86b698d67-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-07283dae-86f2-459c-ad46-12b86b698d67-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Acquiring lock "cinder-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:56 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" returned: 0 in 0.483s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:56 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e 1G Jul 14 20:34:56 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "cinder-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "cinder-quobyte-07283dae-86f2-459c-ad46-12b86b698d67" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:56 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-07283dae-86f2-459c-ad46-12b86b698d67" acquired by "delete_volume" :: waited 0.038s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:56 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Acquiring lock "cinder-quobyte-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.485s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b0a78a-084c-4bab-8d2d-40292cc90968]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Deleted volume successfully. Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "cinder-quobyte-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" acquired by "delete_volume" :: waited 0.040s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:57 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3.e70b9b9a-9946-41f7-84c6-93ed2e433275" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d96334-245e-412d-b0c6-bee9554f6897]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-e70b9b9a-9946-41f7-84c6-93ed2e433275" released by "_delete_snapshot" :: held 1.769s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-de2ee7e6-5534-4ebb-929d-b80229ab4ee3 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-5d081819-2b23-4f0f-a087-4729ae797078-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" released by "delete_snapshot" :: held 1.800s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:57 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 Jul 14 20:34:57 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Created reservations ['1498cdd3-6728-4750-95e2-3cfaefe81f34', 'ea9165b3-95f1-469f-af9d-701aa0ad42a8', '401eba2f-7084-4aeb-9d51-9a993895e2b0', '5ef441c5-c82c-4ffb-9312-85cd3673eeea'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:57 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Delete snapshot completed successfully. Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1e41aff1-fe98-4c93-9ca7-c0a2bb256c25 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-e70b9b9a-9946-41f7-84c6-93ed2e433275-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:57 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c Jul 14 20:34:57 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e 1G" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e Jul 14 20:34:57 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-94fb5982-a47f-49c1-b09e-c0ba35db09c3-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67" returned: 0 in 0.456s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67 Jul 14 20:34:57 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-94fb5982-a47f-49c1-b09e-c0ba35db09c3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:57 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" returned: 0 in 0.533s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f529d4e0-4140-46ec-a625-1f91dc302522]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c Jul 14 20:34:57 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" returned: 0 in 0.364s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e is being set with open permissions: ugo+rw Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:57 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e Jul 14 20:34:57 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 Jul 14 20:34:57 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:57 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-07283dae-86f2-459c-ad46-12b86b698d67" returned: 0 in 0.344s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-quobyte-07283dae-86f2-459c-ad46-12b86b698d67" released by "delete_volume" :: held 0.854s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Created reservations ['5248bce8-7166-4b87-9599-fee82dbf0171', '32e92f56-88f3-4415-a52e-9f0257fa85b4', 'f1036dd2-b343-4797-b09b-d9dc55173cba', '4c9212cd-24d1-4278-b222-a95a5e5c2d3a'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:57 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:57 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "cinder-quobyte-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c" released by "delete_volume" :: held 0.909s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Created reservations ['8941e561-4051-4b0e-8839-1b64bedac924', 'c1283243-ee09-408f-b2ff-e9ff026aeeb8', '7b4ec68d-3941-4650-9fa0-f08dfcce2392', 'e4c7531e-519a-448e-83e5-8e4011b81727'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:58 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3" returned: 0 in 0.438s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" returned: 0 in 0.381s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3 Jul 14 20:34:58 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info Jul 14 20:34:58 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:58 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Deleted volume successfully. Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-00cccfb0-3a56-4778-a115-7f296d9dd629 tempest-CinderUnicodeTest-1765200462 None] Lock "cinder-07283dae-86f2-459c-ad46-12b86b698d67-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:58 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-94fb5982-a47f-49c1-b09e-c0ba35db09c3" returned: 0 in 0.307s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-94fb5982-a47f-49c1-b09e-c0ba35db09c3" released by "delete_volume" :: held 0.826s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:58 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:58 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Deleted volume successfully. Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info" returned: 0 in 0.314s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info is being set with open permissions: ugo+rw Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Created reservations ['426b6895-0429-49f6-b741-9a0797b9eb2a', '29e24f22-f008-421a-a66c-c4da6c214421', '9eba1b97-422a-421c-89f6-e7c78880bb84', '186c9582-2c96-49c9-bbdc-edb4f2aeafb2'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:34:58 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info Jul 14 20:34:58 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b23d9130-18b4-4978-9eb5-a6c65f6d6fb1 tempest-ProjectReaderTests-839359662 None] Lock "cinder-76d02f1b-6a92-4eb3-ba2a-a264f8e3068c-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:58 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:34:58 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:58 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.info" returned: 0 in 0.272s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-93419d3d-a9ce-4cfc-9dd0-c0352fc6adde tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:34:58 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:34:58 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Deleted volume successfully. Jul 14 20:34:58 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-e10dfa3d-763b-4ba4-8c68-7e710f77f7a7 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-94fb5982-a47f-49c1-b09e-c0ba35db09c3-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (f588a66d-3ce8-47f6-a7ab-bae00311f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950cd1d6-b893-4fff-951f-a30a095df89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950cd1d6-b893-4fff-951f-a30a095df89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121139553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5c885-97a6-4596-b784-3aa9f310d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:59Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc06b364-ae61-414e-991e-08c1febf138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc06b364-ae61-414e-991e-08c1febf138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe07246-43dd-42be-a924-ed5578fdc49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe07246-43dd-42be-a924-ed5578fdc49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce5c885-97a6-4596-b784-3aa9f310d495', 'volume_name': 'volume-6ce5c885-97a6-4596-b784-3aa9f310d495', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417a7991-c732-425c-a189-d450b51f6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417a7991-c732-425c-a189-d450b51f6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2270c820-65dc-45e9-ba65-b481f2018f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Volume 6ce5c885-97a6-4596-b784-3aa9f310d495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce5c885-97a6-4596-b784-3aa9f310d495', 'volume_size': 1} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121139553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5c885-97a6-4596-b784-3aa9f310d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:34:59Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Creating volume 6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:34:59 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:59 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 1073741824 Jul 14 20:34:59 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot c8c4beff-9a22-4f48-a3bb-6fbb80a2278e of volume fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da30e6-f435-47a3-8e38-7c139c60be5a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Flow 'volume_create_manager' (d4e0cc19-e077-4f79-b3d3-cdf01dce326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f60cd6-5135-4521-999b-42a1d1a1ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f60cd6-5135-4521-999b-42a1d1a1ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109094959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79609703-cd37-424a-babd-27558032c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaaa7da0a3f343bc95403027bc149a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:00Z,use_quota=True,user_id='8d6269661b0a42708c286bb366b770fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ad30e-b64a-41db-934e-cd86d401e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ad30e-b64a-41db-934e-cd86d401e43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e Jul 14 20:34:59 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ebd10a-fa95-4f62-8684-8ae69028aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ebd10a-fa95-4f62-8684-8ae69028aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79609703-cd37-424a-babd-27558032c71e', 'volume_name': 'volume-79609703-cd37-424a-babd-27558032c71e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26444bda-4e22-4b74-a3bf-abd9ceba2964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26444bda-4e22-4b74-a3bf-abd9ceba2964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b987f4b-08db-4ae7-8374-f8c898db17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:34:59 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Volume 79609703-cd37-424a-babd-27558032c71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79609703-cd37-424a-babd-27558032c71e', 'volume_size': 1} Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:34:59 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 14 20:34:59 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 1073741824" returned: 0 in 0.668s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:00 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 Jul 14 20:35:00 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:00 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" returned: 0 in 0.512s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1628af2-a40d-4383-8dd5-2f856708fc49]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:00 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495" returned: 0 in 0.302s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109094959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79609703-cd37-424a-babd-27558032c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaaa7da0a3f343bc95403027bc149a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:00Z,use_quota=True,user_id='8d6269661b0a42708c286bb366b770fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Creating volume 79609703-cd37-424a-babd-27558032c71e {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:00 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:00 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c Jul 14 20:35:00 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:00 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e 1073741824 Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2270c820-65dc-45e9-ba65-b481f2018f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce5c885-97a6-4596-b784-3aa9f310d495', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:00 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65cd817-ec3b-4d57-8359-f7805308db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:00 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Volume volume-6ce5c885-97a6-4596-b784-3aa9f310d495 (6ce5c885-97a6-4596-b784-3aa9f310d495): created successfully Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65cd817-ec3b-4d57-8359-f7805308db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (f588a66d-3ce8-47f6-a7ab-bae00311f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:00 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-08e348f0-5346-451d-877c-33b3153cda2c tempest-ProjectReaderTests-1124851849 None] Created volume successfully. Jul 14 20:35:00 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" returned: 0 in 0.449s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:00 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e Jul 14 20:35:00 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:00 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e 1073741824" returned: 0 in 0.568s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:00 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:01 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e Jul 14 20:35:01 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:01 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" returned: 0 in 0.391s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:01 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e Jul 14 20:35:01 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:01 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b987f4b-08db-4ae7-8374-f8c898db17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79609703-cd37-424a-babd-27558032c71e', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640e7bf5-69d7-45ab-9df7-3d26652d8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:01 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Volume volume-79609703-cd37-424a-babd-27558032c71e (79609703-cd37-424a-babd-27558032c71e): created successfully Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640e7bf5-69d7-45ab-9df7-3d26652d8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Flow 'volume_create_manager' (d4e0cc19-e077-4f79-b3d3-cdf01dce326b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a48e31d3-3513-44bb-acac-13faa9a3d228 tempest-ProjectReaderTests-839359662 None] Created volume successfully. Jul 14 20:35:01 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c.c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" returned: 0 in 0.294s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e" released by "_delete_snapshot" :: held 1.765s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" released by "delete_snapshot" :: held 1.802s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Creating offline snapshot 93fba308-eeb2-4394-a5c1-c60eb1b966be of volume 6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Created reservations ['a1b37850-33a8-4016-8870-b4bdde2d3c79', '12f4fb98-bb82-431d-b71d-5b8eb4775424', '001eb7d1-b273-4a0a-91e6-7386659ae719', '7bc81df4-fa1c-4a77-9ad1-c22e352d6661'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[395dff94-8b58-4822-b2d7-43aa6311abe1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:01 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-ae169531-c245-46ff-a481-0008e22b0b4c tempest-ProjectMemberTests-646539804 None] Lock "cinder-c8c4beff-9a22-4f48-a3bb-6fbb80a2278e-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:01 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 Jul 14 20:35:01 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Acquiring lock "cinder-79609703-cd37-424a-babd-27558032c71e-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "cinder-79609703-cd37-424a-babd-27558032c71e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Acquiring lock "cinder-quobyte-79609703-cd37-424a-babd-27558032c71e" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:01 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "cinder-quobyte-79609703-cd37-424a-babd-27558032c71e" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:02 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef7767-b00c-4211-b782-be75d823e9e1]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495" returned: 0 in 0.497s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba64479-a424-4f2b-a0ff-56bfe259e3b7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be 1G Jul 14 20:35:02 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e Jul 14 20:35:02 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c Jul 14 20:35:02 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e Jul 14 20:35:02 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" returned: 0 in 0.466s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be 1G" returned: 0 in 0.504s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce5c885-97a6-4596-b784-3aa9f310d495 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c Jul 14 20:35:02 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce5c885-97a6-4596-b784-3aa9f310d495 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be Jul 14 20:35:02 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:02 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-79609703-cd37-424a-babd-27558032c71e" returned: 0 in 0.311s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "cinder-quobyte-79609703-cd37-424a-babd-27558032c71e" released by "delete_volume" :: held 0.789s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-0466cb56-f0aa-4cf7-b670-917e53d491b5 tempest-ProjectAdminTests-591915441 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87600) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Created reservations ['9aa7efb5-8b4d-48a7-bb35-8d1b8d49536e', '33b0f341-4972-48cf-9e50-78bfbbe0b2ef', 'cf8435d5-bfcc-499d-b3f6-bf056001a3f7', 'e385c9d0-ff19-41c8-be34-3046354ccc18'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:02 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" returned: 0 in 0.297s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c" released by "delete_volume" :: held 0.866s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce5c885-97a6-4596-b784-3aa9f310d495 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be" returned: 0 in 0.412s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:02 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be is being set with open permissions: ugo+rw Jul 14 20:35:02 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:02 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:03 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:03 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be Jul 14 20:35:03 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Created reservations ['068370dd-85cf-4655-adb1-52c7abcd8ec4', 'e800480d-8440-48ed-91d6-1faef8540256', '6a741335-a864-4dba-85b8-6af5eff0f58e', 'de2fbb84-3fcc-41f0-a04c-e76081d8eebc'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:03 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:03 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:03 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be" returned: 0 in 0.299s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:03 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:03 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:03 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Deleted volume successfully. Jul 14 20:35:03 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info Jul 14 20:35:03 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1a483683-55c9-43a8-87fb-8701f24844a0 tempest-ProjectReaderTests-839359662 None] Lock "cinder-79609703-cd37-424a-babd-27558032c71e-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:03 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.356s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:03 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-7d2bfa07-7cb0-42cb-bea3-12bfce4ca9c9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-fc5f9b6a-5cee-4fb9-90ac-b70e963fe15c-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:03 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.337s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:35:03 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info" returned: 0 in 0.399s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:03 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info is being set with open permissions: ugo+rw Jul 14 20:35:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:03 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info Jul 14 20:35:03 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:04 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.info" returned: 0 in 0.289s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:04 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-10c6c6a3-47c6-498a-994d-bdbae6f96351 tempest-ProjectReaderTests-1124851849 None] Create snapshot completed successfully Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (ecf6dcd0-0aca-41b4-b543-77153d29c9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbab2e3-31b4-4c13-a4ce-c9855037cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbab2e3-31b4-4c13-a4ce-c9855037cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243952962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066a4202-25f3-42b3-978c-999c85447a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:05Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e57afe9-b570-4e7d-83bf-d2f64c25c211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e57afe9-b570-4e7d-83bf-d2f64c25c211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cb84a-c95f-40ea-ad31-fe7f6e786729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cb84a-c95f-40ea-ad31-fe7f6e786729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066a4202-25f3-42b3-978c-999c85447a12', 'volume_name': 'volume-066a4202-25f3-42b3-978c-999c85447a12', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea51878-7158-46a6-a10d-1211a68e1f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea51878-7158-46a6-a10d-1211a68e1f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6c781e-eedb-46e9-87d0-1704aec789ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:04 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Volume 066a4202-25f3-42b3-978c-999c85447a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066a4202-25f3-42b3-978c-999c85447a12', 'volume_size': 1} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243952962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066a4202-25f3-42b3-978c-999c85447a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:05Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Creating volume 066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:04 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-93fba308-eeb2-4394-a5c1-c60eb1b966be-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-93fba308-eeb2-4394-a5c1-c60eb1b966be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:04 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 1073741824 Jul 14 20:35:04 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-93fba308-eeb2-4394-a5c1-c60eb1b966be" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-93fba308-eeb2-4394-a5c1-c60eb1b966be" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Deleting offline snapshot 93fba308-eeb2-4394-a5c1-c60eb1b966be of volume 6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:04 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] snapshot_file for this snap is: volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[77460df1-54e4-4053-8e28-be112aafa46e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:05 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be Jul 14 20:35:05 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:05 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be" returned: 0 in 0.479s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce5c885-97a6-4596-b784-3aa9f310d495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:05 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 1073741824" returned: 0 in 0.674s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccfef07-2e07-47f6-a6b7-b5148e3a1edb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:05 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 Jul 14 20:35:05 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:05 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 Jul 14 20:35:05 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:05 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12" returned: 0 in 0.397s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:05 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6c781e-eedb-46e9-87d0-1704aec789ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066a4202-25f3-42b3-978c-999c85447a12', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bff419-e7bb-4920-93ed-17f54ec04df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:06 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495" returned: 0 in 0.485s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:06 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Volume volume-066a4202-25f3-42b3-978c-999c85447a12 (066a4202-25f3-42b3-978c-999c85447a12): created successfully Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bff419-e7bb-4920-93ed-17f54ec04df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (ecf6dcd0-0aca-41b4-b543-77153d29c9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:06 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be Jul 14 20:35:06 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a2d7bb51-cf25-45ed-99a8-7e526fb8f472 tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:35:06 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be" returned: 0 in 0.351s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:06 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be Jul 14 20:35:06 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:06 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495.93fba308-eeb2-4394-a5c1-c60eb1b966be" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-93fba308-eeb2-4394-a5c1-c60eb1b966be" released by "_delete_snapshot" :: held 1.695s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" released by "delete_snapshot" :: held 1.737s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Created reservations ['001f01ca-9ecc-4ead-97bf-45334031a26a', '78ac751c-ef48-431b-9dd3-7b01cb865389', 'b50acc48-25b4-4fc2-ad7c-554ef3108679', '3a5ee8cb-81a5-4565-a5be-3f6dd77145cd'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:06 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Delete snapshot completed successfully. Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-16712216-8c85-495c-82ea-5b4ccb5b15cd tempest-ProjectReaderTests-1124851849 None] Lock "cinder-93fba308-eeb2-4394-a5c1-c60eb1b966be-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:06 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Creating offline snapshot 1541e63a-f9fd-4bc9-bd47-567ef600fc67 of volume 066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-6ce5c885-97a6-4596-b784-3aa9f310d495-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead93d2-f6dc-4452-868e-18ad77b8174a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-6ce5c885-97a6-4596-b784-3aa9f310d495-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[42805d0a-d509-4a1f-ad4d-7fcaf2768654]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:07 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 Jul 14 20:35:07 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:07 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 Jul 14 20:35:07 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:07 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12" returned: 0 in 0.447s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:07 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 1G Jul 14 20:35:07 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:07 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495" returned: 0 in 0.388s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:07 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495 Jul 14 20:35:07 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:07 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-6ce5c885-97a6-4596-b784-3aa9f310d495" returned: 0 in 0.277s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-6ce5c885-97a6-4596-b784-3aa9f310d495" released by "delete_volume" :: held 0.730s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Created reservations ['4ab0e981-ae77-45b8-a010-cb1cedeb835c', '4352f355-9515-4beb-b603-3224afa1655f', 'd3b0061f-d7da-43f9-936d-64dfccd2a830', '92c5bec1-50df-439f-ba7c-645793c76cc5'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:07 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 1G" returned: 0 in 0.429s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:07 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066a4202-25f3-42b3-978c-999c85447a12 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:07 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066a4202-25f3-42b3-978c-999c85447a12 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 Jul 14 20:35:07 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:08 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:08 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:08 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066a4202-25f3-42b3-978c-999c85447a12 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67" returned: 0 in 0.354s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:08 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 is being set with open permissions: ugo+rw Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:08 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:08 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Deleted volume successfully. Jul 14 20:35:08 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 Jul 14 20:35:08 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-cf7fb137-a407-4f4e-a992-1a14b1dda845 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-6ce5c885-97a6-4596-b784-3aa9f310d495-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:08 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67" returned: 0 in 0.295s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:08 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info Jul 14 20:35:08 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (5d57ad5f-a0d8-48cd-97e0-cbc2c1bfa95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1ac0d1-be50-4f1e-b5b4-791c59ab5362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1ac0d1-be50-4f1e-b5b4-791c59ab5362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039779925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c216a1-2f28-408f-9838-041a6ba0e1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:09Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da20ce6b-cd8c-4a11-b9a5-4c040430feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da20ce6b-cd8c-4a11-b9a5-4c040430feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78e53a6-f0b4-4149-970e-a012703e8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78e53a6-f0b4-4149-970e-a012703e8639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c216a1-2f28-408f-9838-041a6ba0e1b4', 'volume_name': 'volume-34c216a1-2f28-408f-9838-041a6ba0e1b4', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d212ae2-80bc-4c43-8a8d-0a13285b82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d212ae2-80bc-4c43-8a8d-0a13285b82a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c64980-4b09-4b50-a496-0f3561c51c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:08 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Volume 34c216a1-2f28-408f-9838-041a6ba0e1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c216a1-2f28-408f-9838-041a6ba0e1b4', 'volume_size': 1} Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:08 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info" returned: 0 in 0.276s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:08 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info is being set with open permissions: ugo+rw Jul 14 20:35:08 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:08 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info Jul 14 20:35:08 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:09 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.info" returned: 0 in 0.239s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.335s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039779925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c216a1-2f28-408f-9838-041a6ba0e1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b77d4ea18df4546b0776367003fc880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:09Z,use_quota=True,user_id='11ae90846fa94fc09683e7d8145ba5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Creating volume 34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:09 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:09 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 1073741824 Jul 14 20:35:09 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3cee53cd-a249-4180-851b-45d1abca990c tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:35:09 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 1073741824" returned: 0 in 0.463s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:09 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 Jul 14 20:35:09 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:09 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c64980-4b09-4b50-a496-0f3561c51c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c216a1-2f28-408f-9838-041a6ba0e1b4', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30db3734-a2cf-4d7d-b985-2f828b4132df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:09 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Volume volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 (34c216a1-2f28-408f-9838-041a6ba0e1b4): created successfully Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30db3734-a2cf-4d7d-b985-2f828b4132df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:09 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Flow 'volume_create_manager' (5d57ad5f-a0d8-48cd-97e0-cbc2c1bfa95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:09 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c4ac75e5-2be2-46c7-a3f4-b3ba98132e0b tempest-ProjectReaderTests-1124851849 None] Created volume successfully. Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-1541e63a-f9fd-4bc9-bd47-567ef600fc67-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-1541e63a-f9fd-4bc9-bd47-567ef600fc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-1541e63a-f9fd-4bc9-bd47-567ef600fc67" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-1541e63a-f9fd-4bc9-bd47-567ef600fc67" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot 1541e63a-f9fd-4bc9-bd47-567ef600fc67 of volume 066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed212c3-cb3b-4029-b3c4-49b2cf9366ac]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:10 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 Jul 14 20:35:10 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:10 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67" returned: 0 in 0.368s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-066a4202-25f3-42b3-978c-999c85447a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f09797-7b61-4785-8f0b-0a3b6da171bc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:10 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:10 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 Jul 14 20:35:10 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Creating offline snapshot 550b3b0c-0fab-402e-ba26-413ec302546d of volume 34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e3290-4495-4706-84b7-a4814b49f50d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:11 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12" returned: 0 in 0.455s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:11 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 Jul 14 20:35:11 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 Jul 14 20:35:11 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4" returned: 0 in 0.357s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:11 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d 1G Jul 14 20:35:11 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:11 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67 Jul 14 20:35:11 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12.1541e63a-f9fd-4bc9-bd47-567ef600fc67" returned: 0 in 0.245s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-1541e63a-f9fd-4bc9-bd47-567ef600fc67" released by "_delete_snapshot" :: held 1.519s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" released by "delete_snapshot" :: held 1.542s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Created reservations ['6fe31990-5589-4d53-9fb0-8bb39514ce89', 'c1f67b53-670c-4d87-bb3d-1a2890ad01a1', 'e6728635-c6e3-4b3e-99d0-c0a5783796a2', '4bb794b6-07e6-4497-ad3c-62980dd05cf8'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:11 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d 1G" returned: 0 in 0.407s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:11 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d Jul 14 20:35:11 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:11 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:11 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-b11b3b2b-dc6e-40aa-b53f-021a34d3aa74 tempest-ProjectMemberTests-646539804 None] Lock "cinder-1541e63a-f9fd-4bc9-bd47-567ef600fc67-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:12 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d" returned: 0 in 0.280s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:12 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d is being set with open permissions: ugo+rw Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:12 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d Jul 14 20:35:12 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-066a4202-25f3-42b3-978c-999c85447a12-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "cinder-066a4202-25f3-42b3-978c-999c85447a12-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:12 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:12 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info Jul 14 20:35:12 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0e733-b56c-4d8d-bb61-dbca8986aaff]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:12 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 Jul 14 20:35:12 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:12 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info" returned: 0 in 0.245s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:12 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info is being set with open permissions: ugo+rw Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:12 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info Jul 14 20:35:12 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:12 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:12 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12 Jul 14 20:35:12 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:12 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.info" returned: 0 in 0.242s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:12 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:12 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-06e70418-c0e9-4dbe-8363-6447f88a208d tempest-ProjectReaderTests-1124851849 None] Create snapshot completed successfully Jul 14 20:35:13 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-066a4202-25f3-42b3-978c-999c85447a12" returned: 0 in 0.258s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-066a4202-25f3-42b3-978c-999c85447a12" released by "delete_volume" :: held 0.679s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-550b3b0c-0fab-402e-ba26-413ec302546d-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-550b3b0c-0fab-402e-ba26-413ec302546d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Created reservations ['e4ace4f3-d61b-4aa5-a3cd-477a3e5e0e49', '05c681b3-4039-4f7f-90f9-656189231f0d', 'ce8f82de-919e-43bc-9787-ed864448011d', 'd7b46231-fa43-4443-8bc0-fbf08b5d4c95'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-550b3b0c-0fab-402e-ba26-413ec302546d" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-550b3b0c-0fab-402e-ba26-413ec302546d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Deleting offline snapshot 550b3b0c-0fab-402e-ba26-413ec302546d of volume 34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] snapshot_file for this snap is: volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a1d76-7430-4731-81f9-cbb2a997ea2f]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:13 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:13 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:13 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d Jul 14 20:35:13 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:13 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:13 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-13c5ec79-ee30-495c-9a78-cdf2e52c96f3 tempest-ProjectMemberTests-646539804 None] Lock "cinder-066a4202-25f3-42b3-978c-999c85447a12-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:13 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d" returned: 0 in 0.400s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c216a1-2f28-408f-9838-041a6ba0e1b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331db1a-f911-4952-9a59-e97327a7d5dc]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:13 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:13 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 Jul 14 20:35:13 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (261af6ac-4a0b-473e-9f26-f5ffa39a29b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e5e22-1507-462d-a1e4-4c199ab5e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e5e22-1507-462d-a1e4-4c199ab5e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790171415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ecab69-6ccc-4d19-b417-133e15801229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:14Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcce5d4e-3e3d-4f64-8e3b-797a73faf7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcce5d4e-3e3d-4f64-8e3b-797a73faf7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f2dc29-69a5-4747-9b37-0ead00b8c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f2dc29-69a5-4747-9b37-0ead00b8c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ecab69-6ccc-4d19-b417-133e15801229', 'volume_name': 'volume-69ecab69-6ccc-4d19-b417-133e15801229', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2156aa84-0c08-4437-891c-4b328a4742fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2156aa84-0c08-4437-891c-4b328a4742fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578fd96-b778-4d3b-ab6c-4bb81233c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Volume 69ecab69-6ccc-4d19-b417-133e15801229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ecab69-6ccc-4d19-b417-133e15801229', 'volume_size': 1} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790171415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ecab69-6ccc-4d19-b417-133e15801229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:14Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Creating volume 69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:14 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4" returned: 0 in 0.436s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:14 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 1073741824 Jul 14 20:35:14 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:14 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d Jul 14 20:35:14 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:14 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d" returned: 0 in 0.322s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:14 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d Jul 14 20:35:14 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:14 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 1073741824" returned: 0 in 0.420s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:14 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 Jul 14 20:35:14 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:14 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4.550b3b0c-0fab-402e-ba26-413ec302546d" returned: 0 in 0.263s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-550b3b0c-0fab-402e-ba26-413ec302546d" released by "_delete_snapshot" :: held 1.525s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" released by "delete_snapshot" :: held 1.556s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Created reservations ['d020e195-5dcc-4860-b791-a37b393826fb', '3467af62-1b6d-44cc-83b2-ed0b17ae6152', 'e63de995-27f3-4f05-b002-e79607f6ac77', 'ff913b83-373c-4ef1-ba7e-74f5a28e663f'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:14 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Delete snapshot completed successfully. Jul 14 20:35:14 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229" returned: 0 in 0.292s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-345c2f0c-f02d-4323-8bb0-52587cc3d6f5 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-550b3b0c-0fab-402e-ba26-413ec302546d-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578fd96-b778-4d3b-ab6c-4bb81233c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ecab69-6ccc-4d19-b417-133e15801229', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dd9a56-f3ac-421b-9ec3-8f50a0736fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:14 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Volume volume-69ecab69-6ccc-4d19-b417-133e15801229 (69ecab69-6ccc-4d19-b417-133e15801229): created successfully Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dd9a56-f3ac-421b-9ec3-8f50a0736fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:14 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (261af6ac-4a0b-473e-9f26-f5ffa39a29b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:14 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-147607ae-9069-42ee-9f1d-51fc8e290eac tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Creating offline snapshot 4ca8c535-3382-4e73-b691-1d0fa9c1199e of volume 69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be8932-8efa-4b53-a61f-d2b8bec73e44]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:15 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 Jul 14 20:35:15 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-34c216a1-2f28-408f-9838-041a6ba0e1b4-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-34c216a1-2f28-408f-9838-041a6ba0e1b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aca82a-e8dd-4363-b9ce-76c1564f4f78]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:15 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 Jul 14 20:35:15 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:15 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229" returned: 0 in 0.366s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:15 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e 1G Jul 14 20:35:15 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:15 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:15 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4 Jul 14 20:35:15 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:15 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e 1G" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ecab69-6ccc-4d19-b417-133e15801229 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:15 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ecab69-6ccc-4d19-b417-133e15801229 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e Jul 14 20:35:15 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:16 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-34c216a1-2f28-408f-9838-041a6ba0e1b4" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-quobyte-34c216a1-2f28-408f-9838-041a6ba0e1b4" released by "delete_volume" :: held 0.696s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Created reservations ['c1e5527c-8f5d-4f5f-95ca-3c8f78868dea', 'ef7c7179-13bb-4b3c-bdfe-2e20d9d9a4ea', 'b975bd57-8cf2-430f-97b6-c0d0a9874e39', 'c2e49401-a8d0-4d61-8093-f21292d93be3'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:16 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:16 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:16 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ecab69-6ccc-4d19-b417-133e15801229 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e" returned: 0 in 0.301s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:16 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e is being set with open permissions: ugo+rw Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:16 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e Jul 14 20:35:16 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:16 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.265s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:16 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Deleted volume successfully. Jul 14 20:35:16 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2a4f558a-e220-4ab1-8f28-947b50667e92 tempest-ProjectReaderTests-1124851849 None] Lock "cinder-34c216a1-2f28-408f-9838-041a6ba0e1b4-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e" returned: 0 in 0.256s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:16 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info Jul 14 20:35:16 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:16 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info" returned: 0 in 0.245s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:16 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info is being set with open permissions: ugo+rw Jul 14 20:35:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:16 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info Jul 14 20:35:16 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:17 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.info" returned: 0 in 0.271s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:17 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-cdf062c0-af38-44c7-86e9-2c819482e8aa tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-4ca8c535-3382-4e73-b691-1d0fa9c1199e-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-4ca8c535-3382-4e73-b691-1d0fa9c1199e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-4ca8c535-3382-4e73-b691-1d0fa9c1199e" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4ca8c535-3382-4e73-b691-1d0fa9c1199e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot 4ca8c535-3382-4e73-b691-1d0fa9c1199e of volume 69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efa93c-feee-484e-9885-b70195da36de]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:17 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e Jul 14 20:35:17 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:17 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ecab69-6ccc-4d19-b417-133e15801229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9588145-2085-4572-8c72-4b7f51d0effe]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:17 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 Jul 14 20:35:17 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:18 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229" returned: 0 in 0.384s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:18 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e Jul 14 20:35:18 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:18 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e" returned: 0 in 0.322s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:18 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e Jul 14 20:35:18 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:18 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229.4ca8c535-3382-4e73-b691-1d0fa9c1199e" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4ca8c535-3382-4e73-b691-1d0fa9c1199e" released by "_delete_snapshot" :: held 1.437s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" released by "delete_snapshot" :: held 1.464s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Created reservations ['8e769370-1610-4ba5-9c9f-ff5c4da0d860', '6034329b-f347-4bb0-93bd-aad17f33eac8', 'aeecf0ab-9fc3-45e5-8aca-c318d8f3f15c', '2ab1eae9-a3a1-4d6d-bf7c-d9df7b459149'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:18 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-d00ffe3b-88b2-4769-917f-95112f8053a9 tempest-ProjectMemberTests-646539804 None] Lock "cinder-4ca8c535-3382-4e73-b691-1d0fa9c1199e-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-69ecab69-6ccc-4d19-b417-133e15801229-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "cinder-69ecab69-6ccc-4d19-b417-133e15801229-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7c595-36be-46ae-9d44-1384622a3d1a]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:19 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 Jul 14 20:35:19 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:19 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229" returned: 0 in 0.365s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:19 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229 Jul 14 20:35:19 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:20 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-69ecab69-6ccc-4d19-b417-133e15801229" returned: 0 in 0.274s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-69ecab69-6ccc-4d19-b417-133e15801229" released by "delete_volume" :: held 0.705s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Created reservations ['62f4917d-55ad-4a0f-bc98-44fddaf36ac5', 'f70ac234-af28-49c7-b8b9-50707d7f4c2f', '20bde2f5-7445-47a7-adf2-f70b0797c21d', '66aa1696-47ca-459a-ad78-55fa91775657'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:20 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:20 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:20 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.262s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:20 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:20 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-2bfcf85b-ce46-4b71-a7f6-94afd8e270c1 tempest-ProjectMemberTests-646539804 None] Lock "cinder-69ecab69-6ccc-4d19-b417-133e15801229-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (03d33da6-2024-4dd0-b04d-af5607959b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a191b8-7c07-4cf2-961b-0801777d8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a191b8-7c07-4cf2-961b-0801777d8b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174598067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2594443d-5982-441a-bf3b-329f451ad1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:21Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487ed6a-7133-4e86-bdd3-e96214bd0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487ed6a-7133-4e86-bdd3-e96214bd0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb57548-3896-48de-bfe9-6cc54538d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb57548-3896-48de-bfe9-6cc54538d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2594443d-5982-441a-bf3b-329f451ad1c4', 'volume_name': 'volume-2594443d-5982-441a-bf3b-329f451ad1c4', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540db2f-6856-45dc-99ce-946089b8d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540db2f-6856-45dc-99ce-946089b8d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c93eb2e-c129-4623-ba86-966fe8f4ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Volume 2594443d-5982-441a-bf3b-329f451ad1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2594443d-5982-441a-bf3b-329f451ad1c4', 'volume_size': 1} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174598067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2594443d-5982-441a-bf3b-329f451ad1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:21Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Creating volume 2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:21 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:21 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 1073741824 Jul 14 20:35:21 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:21 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 1073741824" returned: 0 in 0.469s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:21 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 Jul 14 20:35:21 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:21 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4" returned: 0 in 0.257s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c93eb2e-c129-4623-ba86-966fe8f4ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2594443d-5982-441a-bf3b-329f451ad1c4', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb49b22-9994-4277-81e5-16b8855391d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:21 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Volume volume-2594443d-5982-441a-bf3b-329f451ad1c4 (2594443d-5982-441a-bf3b-329f451ad1c4): created successfully Jul 14 20:35:21 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb49b22-9994-4277-81e5-16b8855391d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (03d33da6-2024-4dd0-b04d-af5607959b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:22 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-2af80a2d-6398-443f-8580-e27b348b8f0f tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Creating offline snapshot 5edee8ae-564c-4ed4-a77b-1977e509c8f7 of volume 2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a76443-edb7-409d-9960-e9388dc6b584]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:22 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 Jul 14 20:35:22 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:22 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4" returned: 0 in 0.341s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:22 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:22 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 1G Jul 14 20:35:22 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:23 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 1G" returned: 0 in 0.386s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2594443d-5982-441a-bf3b-329f451ad1c4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:23 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2594443d-5982-441a-bf3b-329f451ad1c4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 Jul 14 20:35:23 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:23 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2594443d-5982-441a-bf3b-329f451ad1c4 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7" returned: 0 in 0.303s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:23 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 is being set with open permissions: ugo+rw Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:23 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 Jul 14 20:35:23 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:23 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:23 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info Jul 14 20:35:23 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:23 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info" returned: 0 in 0.284s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:23 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info is being set with open permissions: ugo+rw Jul 14 20:35:23 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:23 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info Jul 14 20:35:23 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:24 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.info" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:24 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f0dffdb6-49ce-49ed-ac04-e7a3909b7018 tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-5edee8ae-564c-4ed4-a77b-1977e509c8f7-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-5edee8ae-564c-4ed4-a77b-1977e509c8f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-5edee8ae-564c-4ed4-a77b-1977e509c8f7" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-5edee8ae-564c-4ed4-a77b-1977e509c8f7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot 5edee8ae-564c-4ed4-a77b-1977e509c8f7 of volume 2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a6163-30f3-47c3-8bba-d45a1d846f78]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:24 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 Jul 14 20:35:24 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:24 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7" returned: 0 in 0.348s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2594443d-5982-441a-bf3b-329f451ad1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0d526-0dca-4e2a-9124-bde44e546aba]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:24 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 Jul 14 20:35:24 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:25 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4" returned: 0 in 0.366s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:25 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 Jul 14 20:35:25 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:25 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:25 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7 Jul 14 20:35:25 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:25 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4.5edee8ae-564c-4ed4-a77b-1977e509c8f7" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-5edee8ae-564c-4ed4-a77b-1977e509c8f7" released by "_delete_snapshot" :: held 1.405s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" released by "delete_snapshot" :: held 1.427s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:25 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Created reservations ['e2ba4e06-9806-47f4-99cf-5b87bd50b271', '385661cb-4437-4d3a-bb5f-fffe0f91bb12', '18e4b834-67bc-4a03-8768-f0bee40d51f4', 'b7fa2543-af48-41e1-95ae-18d8cf912969'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:26 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-8250e8a7-8ec4-4396-8e71-373dbb04a49c tempest-ProjectMemberTests-646539804 None] Lock "cinder-5edee8ae-564c-4ed4-a77b-1977e509c8f7-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-2594443d-5982-441a-bf3b-329f451ad1c4-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-2594443d-5982-441a-bf3b-329f451ad1c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427ac0a-df68-499a-9919-b0701cf29554]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:26 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 Jul 14 20:35:26 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:27 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4" returned: 0 in 0.378s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:27 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4 Jul 14 20:35:27 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:27 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-2594443d-5982-441a-bf3b-329f451ad1c4" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-2594443d-5982-441a-bf3b-329f451ad1c4" released by "delete_volume" :: held 0.685s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Created reservations ['35a58dae-fbd7-4866-ab0a-3fb4ca443f38', 'efbfabb1-3cc2-4f32-aea1-93abee3e96ee', 'eb183bf3-65cb-49f3-8bf3-1afeb46b713c', 'af0c7199-3483-459e-b5e0-57003a100aa5'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:27 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:27 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:27 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.259s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-bfa53a09-b059-4938-aa46-55952b146ef2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-2594443d-5982-441a-bf3b-329f451ad1c4-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (31ecde75-05fb-4472-ba67-96605f24cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e24796-a687-432e-a0cb-c592ca5bf238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e24796-a687-432e-a0cb-c592ca5bf238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918728347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3540cb-4759-4636-9273-fd644c1f6a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:28Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cb8b66-3882-4486-868c-f3eac6d9f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cb8b66-3882-4486-868c-f3eac6d9f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b1ac9c-6969-4f7a-8e0b-13555046ee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b1ac9c-6969-4f7a-8e0b-13555046ee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3540cb-4759-4636-9273-fd644c1f6a85', 'volume_name': 'volume-ef3540cb-4759-4636-9273-fd644c1f6a85', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34fadab-99f7-427a-a4a9-9d506b4ea7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34fadab-99f7-427a-a4a9-9d506b4ea7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e844f84-461c-4d6c-b8e1-f30736344305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:28 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Volume ef3540cb-4759-4636-9273-fd644c1f6a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3540cb-4759-4636-9273-fd644c1f6a85', 'volume_size': 1} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918728347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3540cb-4759-4636-9273-fd644c1f6a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:28Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Creating volume ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:28 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:28 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 1073741824 Jul 14 20:35:28 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:28 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 1073741824" returned: 0 in 0.465s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:28 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 Jul 14 20:35:28 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:29 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85" returned: 0 in 0.241s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e844f84-461c-4d6c-b8e1-f30736344305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3540cb-4759-4636-9273-fd644c1f6a85', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6500a6-9dac-4a7e-ae52-e7d3f819ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:29 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Volume volume-ef3540cb-4759-4636-9273-fd644c1f6a85 (ef3540cb-4759-4636-9273-fd644c1f6a85): created successfully Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6500a6-9dac-4a7e-ae52-e7d3f819ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (31ecde75-05fb-4472-ba67-96605f24cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-9131a043-a952-47a7-bf82-195fb4fd2415 tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Creating offline snapshot c8af5b28-143e-45f5-9b4f-43963869f171 of volume ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbded7f-5c68-475a-837b-1c89c2a1b22c]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:29 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 Jul 14 20:35:29 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:29 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85" returned: 0 in 0.374s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:29 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 1G Jul 14 20:35:29 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:30 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 1G" returned: 0 in 0.408s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3540cb-4759-4636-9273-fd644c1f6a85 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:30 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3540cb-4759-4636-9273-fd644c1f6a85 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 Jul 14 20:35:30 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:30 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3540cb-4759-4636-9273-fd644c1f6a85 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171" returned: 0 in 0.291s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:30 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 is being set with open permissions: ugo+rw Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:30 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 Jul 14 20:35:30 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:30 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171" returned: 0 in 0.239s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:30 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info Jul 14 20:35:30 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:31 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info" returned: 0 in 0.253s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:31 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info is being set with open permissions: ugo+rw Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:31 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info Jul 14 20:35:31 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:31 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.info" returned: 0 in 0.255s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:31 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d5524358-7aee-4ace-8a9d-f3988f57cbb2 tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-c8af5b28-143e-45f5-9b4f-43963869f171-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-c8af5b28-143e-45f5-9b4f-43963869f171-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-c8af5b28-143e-45f5-9b4f-43963869f171" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c8af5b28-143e-45f5-9b4f-43963869f171" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot c8af5b28-143e-45f5-9b4f-43963869f171 of volume ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5471256-4e63-4cea-8e64-11c1f0b25d96]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:31 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:31 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 Jul 14 20:35:31 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:32 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171" returned: 0 in 0.369s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef3540cb-4759-4636-9273-fd644c1f6a85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70ccbf-3937-4302-93e9-db60e947ea45]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:32 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 Jul 14 20:35:32 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:32 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85" returned: 0 in 0.359s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:32 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 Jul 14 20:35:32 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:32 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171" returned: 0 in 0.361s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:32 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:32 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171 Jul 14 20:35:32 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:33 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85.c8af5b28-143e-45f5-9b4f-43963869f171" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-c8af5b28-143e-45f5-9b4f-43963869f171" released by "_delete_snapshot" :: held 1.450s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" released by "delete_snapshot" :: held 1.474s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Created reservations ['0b9334ec-e45f-4d13-867c-6ee3faf50413', 'aee975a4-b27b-4353-b135-9ccbab5e43ef', '91ff5328-4bd6-44c5-88af-d4d9e09906ca', 'e72871d7-83eb-47fa-97bc-87ce77e7a7be'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:33 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-21c7110a-bad7-41b6-bd7b-485b1b404f2b tempest-ProjectMemberTests-646539804 None] Lock "cinder-c8af5b28-143e-45f5-9b4f-43963869f171-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-ef3540cb-4759-4636-9273-fd644c1f6a85-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "cinder-ef3540cb-4759-4636-9273-fd644c1f6a85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ee612-68fe-4550-a761-4126decb635d]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:33 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:33 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 Jul 14 20:35:33 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:34 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85" returned: 0 in 0.375s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:34 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85 Jul 14 20:35:34 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:34 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-ef3540cb-4759-4636-9273-fd644c1f6a85" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ef3540cb-4759-4636-9273-fd644c1f6a85" released by "delete_volume" :: held 0.682s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Created reservations ['cc38bcbd-0d3c-4626-9528-a99f80afe5dd', 'fa1ccef0-78f7-4ddb-910d-913cdfc03895', 'ddd02226-724c-4cc4-8a02-b91a18e150b9', 'c4363896-93e3-4541-8090-ff3f997f54ee'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:34 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:34 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:34 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.267s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:34 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:34 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5cca3d52-8468-4746-9e79-b295e2aa78f4 tempest-ProjectMemberTests-646539804 None] Lock "cinder-ef3540cb-4759-4636-9273-fd644c1f6a85-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (b8f0ff05-b7a0-4e28-ae46-6f24b09538a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf0838c-69dc-4e5f-b896-9694ad24121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf0838c-69dc-4e5f-b896-9694ad24121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186668275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a164372-b113-4598-a520-db7cb3f273bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:35Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ee9def-d486-47a1-b14a-b4b275fa54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ee9def-d486-47a1-b14a-b4b275fa54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28a341c-97bb-4559-8f77-5062e5cd639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28a341c-97bb-4559-8f77-5062e5cd639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a164372-b113-4598-a520-db7cb3f273bd', 'volume_name': 'volume-4a164372-b113-4598-a520-db7cb3f273bd', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c1a2a-4631-4cf3-bee5-ed1da8b05dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c1a2a-4631-4cf3-bee5-ed1da8b05dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f016ff6-f851-467d-b4ad-730492fa2391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:35 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Volume 4a164372-b113-4598-a520-db7cb3f273bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a164372-b113-4598-a520-db7cb3f273bd', 'volume_size': 1} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-186668275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a164372-b113-4598-a520-db7cb3f273bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfaaac88b98434d80b7134fa3f5d9ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:35Z,use_quota=True,user_id='a70befacd30946258eeac5ca3cf2b8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Creating volume 4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:35 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:35 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd 1073741824 Jul 14 20:35:35 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:35 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:35 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd 1073741824" returned: 0 in 0.476s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:36 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd Jul 14 20:35:36 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:36 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd" returned: 0 in 0.264s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f016ff6-f851-467d-b4ad-730492fa2391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a164372-b113-4598-a520-db7cb3f273bd', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17a4c89-c412-4258-8dbd-60c593919a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:36 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Volume volume-4a164372-b113-4598-a520-db7cb3f273bd (4a164372-b113-4598-a520-db7cb3f273bd): created successfully Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17a4c89-c412-4258-8dbd-60c593919a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:36 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Flow 'volume_create_manager' (b8f0ff05-b7a0-4e28-ae46-6f24b09538a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:36 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-94c72ff5-6776-4b2c-a209-ed9eb1a4affa tempest-ProjectMemberTests-646539804 None] Created volume successfully. Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Creating offline snapshot ca832abd-3e33-4dd1-a08b-78c75d8f4253 of volume 4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[adada0e8-a8e5-4385-bb96-978007e346a9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:37 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd Jul 14 20:35:37 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:37 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd" returned: 0 in 0.350s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:37 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:38 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 1G Jul 14 20:35:38 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (7ba8a86f-befc-4826-8447-57df63b5cd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f7396-d3fb-456a-97dc-5dc3a8cd117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f7396-d3fb-456a-97dc-5dc3a8cd117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204899343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b17d65-0cec-4017-888d-9caa6dbe6d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:38Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0137b1e6-6450-4d16-9efd-059684cd54df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0137b1e6-6450-4d16-9efd-059684cd54df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1d885-411d-4607-8c00-dd32e699b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:38 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1d885-411d-4607-8c00-dd32e699b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b17d65-0cec-4017-888d-9caa6dbe6d40', 'volume_name': 'volume-24b17d65-0cec-4017-888d-9caa6dbe6d40', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56187e21-43a7-4233-8a98-230228794908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56187e21-43a7-4233-8a98-230228794908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb6090c-6c64-4e7c-860e-97310915789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:38 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Volume 24b17d65-0cec-4017-888d-9caa6dbe6d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b17d65-0cec-4017-888d-9caa6dbe6d40', 'volume_size': 1} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 1G" returned: 0 in 0.432s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a164372-b113-4598-a520-db7cb3f273bd -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:38 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a164372-b113-4598-a520-db7cb3f273bd -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 Jul 14 20:35:38 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:38 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a164372-b113-4598-a520-db7cb3f273bd -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253" returned: 0 in 0.285s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:38 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 is being set with open permissions: ugo+rw Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:38 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 Jul 14 20:35:38 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:38 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253" returned: 0 in 0.236s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:38 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:38 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info Jul 14 20:35:38 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:39 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:39 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info is being set with open permissions: ugo+rw Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:39 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info Jul 14 20:35:39 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:39 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.info" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204899343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b17d65-0cec-4017-888d-9caa6dbe6d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:38Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Creating volume 24b17d65-0cec-4017-888d-9caa6dbe6d40 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:39 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:39 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 1073741824 Jul 14 20:35:39 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:39 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-6306cde6-179d-4786-8d66-16bc59aa4e4b tempest-ProjectMemberTests-646539804 None] Create snapshot completed successfully Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-ca832abd-3e33-4dd1-a08b-78c75d8f4253-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-ca832abd-3e33-4dd1-a08b-78c75d8f4253-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-ca832abd-3e33-4dd1-a08b-78c75d8f4253" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ca832abd-3e33-4dd1-a08b-78c75d8f4253" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Deleting offline snapshot ca832abd-3e33-4dd1-a08b-78c75d8f4253 of volume 4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] snapshot_file for this snap is: volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a158186-863d-459b-b9f4-0789d25f97d9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:39 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:39 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 1073741824" returned: 0 in 0.487s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:40 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 Jul 14 20:35:40 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:40 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 Jul 14 20:35:40 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:40 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb6090c-6c64-4e7c-860e-97310915789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b17d65-0cec-4017-888d-9caa6dbe6d40', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c65077d-67ba-419e-8fec-2f09ca69c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:40 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Volume volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 (24b17d65-0cec-4017-888d-9caa6dbe6d40): created successfully Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c65077d-67ba-419e-8fec-2f09ca69c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (7ba8a86f-befc-4826-8447-57df63b5cd99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:40 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-64893c05-0bf2-474e-984a-76e0dd83f1b4 tempest-ProjectReaderTests-2022222026 None] Created volume successfully. Jul 14 20:35:40 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253" returned: 0 in 0.367s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a164372-b113-4598-a520-db7cb3f273bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d8c0f-9b8e-46ed-b555-8b90a1e0d794]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:40 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd Jul 14 20:35:40 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-24b17d65-0cec-4017-888d-9caa6dbe6d40-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-24b17d65-0cec-4017-888d-9caa6dbe6d40-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-quobyte-24b17d65-0cec-4017-888d-9caa6dbe6d40" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-24b17d65-0cec-4017-888d-9caa6dbe6d40" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d97bf1-8844-4934-b68f-ae0d0469b6c8]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:40 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd" returned: 0 in 0.383s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:40 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:40 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 Jul 14 20:35:40 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:40 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 Jul 14 20:35:40 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:41 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40" returned: 0 in 0.362s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:41 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40 Jul 14 20:35:41 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:41 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253" returned: 0 in 0.346s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:41 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253 Jul 14 20:35:41 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:41 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-24b17d65-0cec-4017-888d-9caa6dbe6d40" returned: 0 in 0.244s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-24b17d65-0cec-4017-888d-9caa6dbe6d40" released by "delete_volume" :: held 0.650s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:41 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd.ca832abd-3e33-4dd1-a08b-78c75d8f4253" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-ca832abd-3e33-4dd1-a08b-78c75d8f4253" released by "_delete_snapshot" :: held 1.436s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" released by "delete_snapshot" :: held 1.461s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Created reservations ['4baa76fe-3284-4f6f-a648-af0e6157fe10', 'c412e112-a85d-445a-801f-9b91fae651ff', 'f9688344-069d-4da6-9fa0-3521e74ad66c', '97ca443d-28a2-48f1-bf30-dbdfec480f47'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Created reservations ['2138e3d2-677a-4358-a9d3-7f0614c0ae4d', '75a92a69-c359-4965-85fe-59de6d4c88fb', '27ec27fd-377a-45af-bcce-661996031ff4', 'd173a9a5-b489-4e2c-9a3e-96ecc9b795b8'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:41 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:41 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Delete snapshot completed successfully. Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-19a0e853-10ee-4c9a-8503-de2f22841430 tempest-ProjectMemberTests-646539804 None] Lock "cinder-ca832abd-3e33-4dd1-a08b-78c75d8f4253-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:41 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.252s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:41 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Deleted volume successfully. Jul 14 20:35:41 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-a6e97f0e-dd8c-44ef-b194-c937a95cfd4b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-24b17d65-0cec-4017-888d-9caa6dbe6d40-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-4a164372-b113-4598-a520-db7cb3f273bd-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-4a164372-b113-4598-a520-db7cb3f273bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db9e4b-cb93-42e4-adf6-e5a2463ce840]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (806fba1f-b70a-4c75-946d-9c5ef8c4d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244443be-ed69-4e2d-ad9b-2e7eb6b83723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244443be-ed69-4e2d-ad9b-2e7eb6b83723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345434285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480638fd-a726-4d5d-b7f7-18e032872e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:42Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023dd5-a5aa-4221-92f4-442c9ce76b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023dd5-a5aa-4221-92f4-442c9ce76b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891b0008-abe1-4cbd-abcc-cf6e7c4dc735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891b0008-abe1-4cbd-abcc-cf6e7c4dc735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480638fd-a726-4d5d-b7f7-18e032872e91', 'volume_name': 'volume-480638fd-a726-4d5d-b7f7-18e032872e91', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00d0065-b2f2-4dd1-b60d-50128c9fee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00d0065-b2f2-4dd1-b60d-50128c9fee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0bbbb5-61d9-4027-8f61-b935f04c9921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:42 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Volume 480638fd-a726-4d5d-b7f7-18e032872e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480638fd-a726-4d5d-b7f7-18e032872e91', 'volume_size': 1} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345434285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480638fd-a726-4d5d-b7f7-18e032872e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:42Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Creating volume 480638fd-a726-4d5d-b7f7-18e032872e91 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:42 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd Jul 14 20:35:42 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:42 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:42 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 1073741824 Jul 14 20:35:42 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:42 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd" returned: 0 in 0.372s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:42 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd Jul 14 20:35:42 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:42 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 1073741824" returned: 0 in 0.413s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:42 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 Jul 14 20:35:42 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:42 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-4a164372-b113-4598-a520-db7cb3f273bd" returned: 0 in 0.251s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-quobyte-4a164372-b113-4598-a520-db7cb3f273bd" released by "delete_volume" :: held 0.697s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Created reservations ['ab621f91-ae6f-4ea0-8122-9db65de823db', 'c664c1cd-e313-453a-b965-e2bf373f82eb', 'fda98344-1f5c-4788-bebf-0263c4ccc1dc', '8b27c3ff-ee81-4586-b6bb-3c43e01ca8da'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:42 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:42 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:42 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:43 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0bbbb5-61d9-4027-8f61-b935f04c9921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480638fd-a726-4d5d-b7f7-18e032872e91', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d09d039-0573-40df-ac0d-d0e0f29d30a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:43 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Volume volume-480638fd-a726-4d5d-b7f7-18e032872e91 (480638fd-a726-4d5d-b7f7-18e032872e91): created successfully Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d09d039-0573-40df-ac0d-d0e0f29d30a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (806fba1f-b70a-4c75-946d-9c5ef8c4d14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-f064aab9-dd9d-4b12-9fbc-8d16dc6c6050 tempest-ProjectReaderTests-2022222026 None] Created volume successfully. Jul 14 20:35:43 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.268s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:43 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Deleted volume successfully. Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-3255b8e6-70b6-4c84-a9dd-ad4f99cdf1d2 tempest-ProjectMemberTests-646539804 None] Lock "cinder-4a164372-b113-4598-a520-db7cb3f273bd-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-480638fd-a726-4d5d-b7f7-18e032872e91-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-480638fd-a726-4d5d-b7f7-18e032872e91-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-quobyte-480638fd-a726-4d5d-b7f7-18e032872e91" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-480638fd-a726-4d5d-b7f7-18e032872e91" acquired by "delete_volume" :: waited 0.019s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc728531-f62f-4d98-9a75-84e842a5a386]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:43 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 Jul 14 20:35:43 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:43 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:43 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:43 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91 Jul 14 20:35:43 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:44 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-480638fd-a726-4d5d-b7f7-18e032872e91" returned: 0 in 0.254s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-480638fd-a726-4d5d-b7f7-18e032872e91" released by "delete_volume" :: held 0.677s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Created reservations ['e296e2d0-6dc6-45c8-bf92-14a65134d9fa', '6490b4d4-3c6a-4e35-9cc8-881bb6475329', '13e28c7c-812e-432c-9c93-b4896234fde9', '5fa55ad3-70dc-410f-a188-1aacf80790e7'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:44 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:44 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:44 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.263s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:44 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Deleted volume successfully. Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-1028304a-ea9d-4aa9-91fb-73345455b48b tempest-ProjectReaderTests-2022222026 None] Lock "cinder-480638fd-a726-4d5d-b7f7-18e032872e91-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=262,cinder:DELETE=25,cinder:SELECT=203,cinder:INSERT=74 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:35:44 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=193,cinder:INSERT=68,cinder:UPDATE=265,cinder:DELETE=18 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (eb6109d5-c0a4-4aa8-98e2-7d0b56557c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ee32bc-b20a-412c-826c-a44bf0ba7e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ee32bc-b20a-412c-826c-a44bf0ba7e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429316016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a440234e-8187-4888-acc6-39bfc0d74fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:45Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee8c39f-c057-4dbc-91a2-e8431c59d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee8c39f-c057-4dbc-91a2-e8431c59d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a505f44-5e23-4dd2-aff4-149c20165618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a505f44-5e23-4dd2-aff4-149c20165618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a440234e-8187-4888-acc6-39bfc0d74fe3', 'volume_name': 'volume-a440234e-8187-4888-acc6-39bfc0d74fe3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ab8ea-e074-4819-a2c1-3f0d0675d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ab8ea-e074-4819-a2c1-3f0d0675d42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cac462-40e4-41a9-8a35-9f6aa9c9c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Volume a440234e-8187-4888-acc6-39bfc0d74fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a440234e-8187-4888-acc6-39bfc0d74fe3', 'volume_size': 1} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429316016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a440234e-8187-4888-acc6-39bfc0d74fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:45Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Creating volume a440234e-8187-4888-acc6-39bfc0d74fe3 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:45 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:45 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 1073741824 Jul 14 20:35:45 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:45 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 1073741824" returned: 0 in 0.437s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:45 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 Jul 14 20:35:45 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:45 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3" returned: 0 in 0.243s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cac462-40e4-41a9-8a35-9f6aa9c9c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a440234e-8187-4888-acc6-39bfc0d74fe3', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da4f816-9267-4e42-b437-6ad2eea74cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:45 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Volume volume-a440234e-8187-4888-acc6-39bfc0d74fe3 (a440234e-8187-4888-acc6-39bfc0d74fe3): created successfully Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da4f816-9267-4e42-b437-6ad2eea74cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:45 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (eb6109d5-c0a4-4aa8-98e2-7d0b56557c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:45 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-a1e47290-cd95-46f4-90c8-8b7f4f3fe1c8 tempest-ProjectReaderTests-2022222026 None] Created volume successfully. Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-a440234e-8187-4888-acc6-39bfc0d74fe3-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-a440234e-8187-4888-acc6-39bfc0d74fe3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-quobyte-a440234e-8187-4888-acc6-39bfc0d74fe3" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-a440234e-8187-4888-acc6-39bfc0d74fe3" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e3235-2663-413c-b537-c748e8acb3d6]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:47 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 Jul 14 20:35:47 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:47 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3" returned: 0 in 0.333s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:47 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3 Jul 14 20:35:47 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:47 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-a440234e-8187-4888-acc6-39bfc0d74fe3" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-a440234e-8187-4888-acc6-39bfc0d74fe3" released by "delete_volume" :: held 0.612s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Created reservations ['557085a9-29c5-428f-9c99-6f42f71550a4', '1b7be4da-46ff-4e23-b329-378d583141c1', '0174173f-8184-400b-90a0-44c18503e0fb', 'f1feaf23-0bde-4698-a826-054962b2d9ae'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:47 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:47 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:47 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:48 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.272s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:48 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Deleted volume successfully. Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-768abf6c-8a11-4351-a4ec-40ce729cb949 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-a440234e-8187-4888-acc6-39bfc0d74fe3-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (41e084ca-bfa3-434c-a52a-5f46020e0b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81fac9b-9ba7-483f-a204-519e88b0d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81fac9b-9ba7-483f-a204-519e88b0d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972856064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e1081d-0b71-464a-aad1-22a335e99f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:49Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33c7478-fa93-4690-8fc8-8e17e2775bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33c7478-fa93-4690-8fc8-8e17e2775bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c7b284-4c7a-4a36-99eb-eeb16d319e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c7b284-4c7a-4a36-99eb-eeb16d319e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e1081d-0b71-464a-aad1-22a335e99f7a', 'volume_name': 'volume-16e1081d-0b71-464a-aad1-22a335e99f7a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bb7f31-8a50-4a28-8f18-b7feea9bd4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bb7f31-8a50-4a28-8f18-b7feea9bd4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc67e670-29fc-4f36-b837-577b70025e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:48 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Volume 16e1081d-0b71-464a-aad1-22a335e99f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e1081d-0b71-464a-aad1-22a335e99f7a', 'volume_size': 1} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972856064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e1081d-0b71-464a-aad1-22a335e99f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4b2c24ce5d49f390bb804e1e4989c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:35:49Z,use_quota=True,user_id='bca67ed874a9444ba02a67ab427b5fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Creating volume 16e1081d-0b71-464a-aad1-22a335e99f7a {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:35:48 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:35:48 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:48 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a 1073741824 Jul 14 20:35:48 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:49 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a 1073741824" returned: 0 in 0.495s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:49 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a Jul 14 20:35:49 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:49 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a" returned: 0 in 0.224s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc67e670-29fc-4f36-b837-577b70025e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e1081d-0b71-464a-aad1-22a335e99f7a', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa705a48-e691-4d7b-b209-2b3841f627e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:35:49 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Volume volume-16e1081d-0b71-464a-aad1-22a335e99f7a (16e1081d-0b71-464a-aad1-22a335e99f7a): created successfully Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa705a48-e691-4d7b-b209-2b3841f627e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Flow 'volume_create_manager' (41e084ca-bfa3-434c-a52a-5f46020e0b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:35:49 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-fb84d85f-7806-4527-aa99-867930c520ae tempest-ProjectReaderTests-2022222026 None] Created volume successfully. Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-16e1081d-0b71-464a-aad1-22a335e99f7a-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-16e1081d-0b71-464a-aad1-22a335e99f7a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "cinder-quobyte-16e1081d-0b71-464a-aad1-22a335e99f7a" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-16e1081d-0b71-464a-aad1-22a335e99f7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40265fd-51d5-45d1-9bba-5c153e695ec7]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:35:49 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:49 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a Jul 14 20:35:49 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:50 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a" returned: 0 in 0.387s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:50 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a Jul 14 20:35:50 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:50 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-16e1081d-0b71-464a-aad1-22a335e99f7a" returned: 0 in 0.249s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-quobyte-16e1081d-0b71-464a-aad1-22a335e99f7a" released by "delete_volume" :: held 0.677s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Created reservations ['336e20bc-51f2-4feb-8833-712ff8dc9afd', '0361f02c-aa9b-4bd9-96b5-1b25c2fffbfa', '3ade2e19-d8c1-456e-81cd-fbea34613fca', '0e77da50-22e1-48d1-865c-60b3ab734f5d'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:35:50 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:35:50 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:35:50 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.250s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:35:50 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Deleted volume successfully. Jul 14 20:35:50 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-c8f1020e-8679-478a-9ac8-e80b9bfeb973 tempest-ProjectReaderTests-2022222026 None] Lock "cinder-16e1081d-0b71-464a-aad1-22a335e99f7a-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:00 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:36:00 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:UPDATE=23,cinder:DELETE=3,cinder:SELECT=15,cinder:INSERT=5 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:03 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:36:03 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:03 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.260s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG oslo_service.periodic_task [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] Running periodic task VolumeManager._thread_info {{(pid=87600) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread count: 28 {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 20:36:03 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-01937430-3fdb-45bf-9b09-9f459fa336cd None None] thread info: [<_MainThread(MainThread, started 133723522019456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87600) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Flow 'volume_create_manager' (c9fd08a1-ee10-4645-8cc8-81bf99679683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041424d2-ea01-41d4-9e34-579044959342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041424d2-ea01-41d4-9e34-579044959342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-26714108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7adcdc9-4200-4f6b-a8ab-af1610aea3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb08750c2e5477f96f152a40bb08450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:36:16Z,use_quota=True,user_id='bc512f89f44640eb94587517da764a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9de7e4e-dd4e-4ab7-b7e4-4f4e412c540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9de7e4e-dd4e-4ab7-b7e4-4f4e412c540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d64b998-b8a9-4a82-96e5-850bd5a39793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d64b998-b8a9-4a82-96e5-850bd5a39793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7adcdc9-4200-4f6b-a8ab-af1610aea3e9', 'volume_name': 'volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f827894c-5bc7-4a05-ad9f-56aa602a50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f827894c-5bc7-4a05-ad9f-56aa602a50c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba83f7b-6fba-40b0-9043-ecf78605e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:15 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Volume b7adcdc9-4200-4f6b-a8ab-af1610aea3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9', 'volume_size': 1} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-26714108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7adcdc9-4200-4f6b-a8ab-af1610aea3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb08750c2e5477f96f152a40bb08450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:36:16Z,use_quota=True,user_id='bc512f89f44640eb94587517da764a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)}" {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Creating volume b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:36:15 devstack cinder-volume[87600]: INFO cinder.volume.drivers.remotefs [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] casted to osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc Jul 14 20:36:15 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 1073741824 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:15 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 1073741824 Jul 14 20:36:15 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:16 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 1073741824" returned: 0 in 0.400s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:16 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:16 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:16 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.228s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'} {{(pid=87600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba83f7b-6fba-40b0-9043-ecf78605e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9', 'volume_size': 1}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba54845-25f0-45d7-a0b9-bd979aa4684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:16 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Volume volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 (b7adcdc9-4200-4f6b-a8ab-af1610aea3e9): created successfully Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba54845-25f0-45d7-a0b9-bd979aa4684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Flow 'volume_create_manager' (c9fd08a1-ee10-4645-8cc8-81bf99679683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:36:16 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-004048b6-311c-4c22-bed8-da9a1adcba47 tempest-SnapshotDependencyTests-1396466980 None] Created volume successfully. Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:16 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Creating offline snapshot f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 of volume b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c54519b-b915-4d7a-9461-a62f02ed1b34]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:17 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:17 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:17 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.332s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 1G {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:17 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 1G Jul 14 20:36:17 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:17 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 1G" returned: 0 in 0.379s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:17 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:17 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:17 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 -F qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.275s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:17 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 is being set with open permissions: ugo+rw Jul 14 20:36:17 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:18 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:18 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:18 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.229s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:18 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info Jul 14 20:36:18 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:18 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info" returned: 0 in 0.242s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:18 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info is being set with open permissions: ugo+rw Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:18 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info Jul 14 20:36:18 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:18 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.info" returned: 0 in 0.238s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:18 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:18 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-d14eff66-2687-479b-bbbc-5e64cb952064 tempest-SnapshotDependencyTests-1396466980 None] Create snapshot completed successfully Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.flows.manager.create_volume [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Flow 'volume_create_manager' (12b465bf-4a9d-44ad-ac01-abd4f5e2c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485af95-be2a-4bfe-aaa9-d86ff6e924fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485af95-be2a-4bfe-aaa9-d86ff6e924fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T18:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c9352f-7562-4d77-ae31-14e93cd38368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb08750c2e5477f96f152a40bb08450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T18:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f75f5e47-d3a7-44ce-bfc2-193ce2035cb4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T18:36:20Z,use_quota=True,user_id='bc512f89f44640eb94587517da764a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebaee5cf-faa3-42d2-9d02-fe9d32b7e379),volume_type_id=ebaee5cf-faa3-42d2-9d02-fe9d32b7e379)' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42eed43d-dc3c-4cea-b6a0-10c9870bb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42eed43d-dc3c-4cea-b6a0-10c9870bb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396ac5d0-7042-4fd2-83d0-b022968ce56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396ac5d0-7042-4fd2-83d0-b022968ce56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6c9352f-7562-4d77-ae31-14e93cd38368', 'volume_name': 'volume-e6c9352f-7562-4d77-ae31-14e93cd38368', 'volume_size': 1, 'snapshot_id': 'f75f5e47-d3a7-44ce-bfc2-193ce2035cb4'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f4baa-f7bc-4ed8-b9da-fdf41c61e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240f4baa-f7bc-4ed8-b9da-fdf41c61e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f918e9ad-7973-4154-9d4f-cdb2f99a18c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:19 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Volume e6c9352f-7562-4d77-ae31-14e93cd38368: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6c9352f-7562-4d77-ae31-14e93cd38368', 'volume_size': 1, 'snapshot_id': 'f75f5e47-d3a7-44ce-bfc2-193ce2035cb4'} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-e6c9352f-7562-4d77-ae31-14e93cd38368" by "_create_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-e6c9352f-7562-4d77-ae31-14e93cd38368" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Creating volume e6c9352f-7562-4d77-ae31-14e93cd38368 from snapshot f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Selected osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc as target Quobyte volume. {{(pid=87600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" by "_copy_volume_from_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] snapshot: f75f5e47-d3a7-44ce-bfc2-193ce2035cb4, volume: e6c9352f-7562-4d77-ae31-14e93cd38368, {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40b8b7-a3bb-4d03-95e9-713a6b761133]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:19 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:19 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:19 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:20 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.349s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Creating direct copy from snapshot {{(pid=87600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b847e50-0c17-4296-a864-77d5fefc4a10]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:20 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:20 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:20 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.340s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG cinder.utils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Path /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 not found in is_blk_device check {{(pid=87600) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 20:36:20 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:20 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 Jul 14 20:36:20 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:24 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368" returned: 0 in 3.815s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a27ca-7700-4d3c-8882-47989ea63015]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:24 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:24 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:24 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.500s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG cinder.image.image_utils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Image conversion details: src /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9, size 1024.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 {{(pid=87600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 20:36:24 devstack cinder-volume[87600]: INFO cinder.image.image_utils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Converted 1024.00 MB image at 268.36 MB/s Jul 14 20:36:24 devstack cinder-volume[87600]: WARNING cinder.volume.drivers.remotefs [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 is being set with open permissions: ugo+rw Jul 14 20:36:24 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:24 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 Jul 14 20:36:24 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:25 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368" returned: 0 in 0.235s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" released by "_copy_volume_from_snapshot" :: held 5.326s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-e6c9352f-7562-4d77-ae31-14e93cd38368" released by "_create_volume_from_snapshot" :: held 5.353s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.366s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f918e9ad-7973-4154-9d4f-cdb2f99a18c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c9352f-7562-4d77-ae31-14e93cd38368', 'volume_size': 1, 'snapshot_id': 'f75f5e47-d3a7-44ce-bfc2-193ce2035cb4'}' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34346e3-7ae5-4d6e-9544-14fbd83a794b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 20:36:25 devstack cinder-volume[87600]: INFO cinder.volume.flows.manager.create_volume [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Volume volume-e6c9352f-7562-4d77-ae31-14e93cd38368 (e6c9352f-7562-4d77-ae31-14e93cd38368): created successfully Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34346e3-7ae5-4d6e-9544-14fbd83a794b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87600) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 20:36:25 devstack cinder-volume[87600]: DEBUG cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Flow 'volume_create_manager' (12b465bf-4a9d-44ad-ac01-abd4f5e2c843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87600) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 20:36:25 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-643b807c-dae1-46d7-9e8f-fc5de8890c3f tempest-SnapshotDependencyTests-1396466980 None] Created volume successfully. Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-delete_snapshot" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" by "delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" by "_delete_snapshot" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Deleting offline snapshot f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 of volume b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] snapshot_file for this snap is: volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a09a46-3f3c-402b-bc46-ea6dc45fa510]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:26 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:26 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:26 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.328s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.remotefs [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b5d4b-5f6a-4069-815c-028d475982fb]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:26 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:26 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:26 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.335s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:26 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:26 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:26 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:27 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.313s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:27 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4 Jul 14 20:36:27 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:27 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9.f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" returned: 0 in 0.224s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4" released by "_delete_snapshot" :: held 1.289s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" released by "delete_snapshot" :: held 1.309s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Created reservations ['5d9d6a1d-9cd5-4347-bcbb-d0917737feec', '9bb5a8e6-7d47-4e17-bd3a-ccadaa855237', '23cfcf6d-b080-4a71-a4c8-854bc1a5a32d', '7ccc14b3-fb2e-4079-a308-1273dbc75c73'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:36:27 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Delete snapshot completed successfully. Jul 14 20:36:27 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-4f2c05ff-75d4-407b-b811-6b4515e8952a tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-f75f5e47-d3a7-44ce-bfc2-193ce2035cb4-delete_snapshot" released by "delete_snapshot" :: held 1.428s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" acquired by "delete_volume" :: waited 0.014s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b2ece0-da5d-4263-a6b9-cfedb6d1da8e]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:28 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:28 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:28 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.352s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:28 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9 Jul 14 20:36:28 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:28 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:28 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" returned: 0 in 0.247s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9" released by "delete_volume" :: held 0.649s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Created reservations ['95550b21-dad2-48db-809d-da8886b1d8bc', '698d55da-2a29-472a-946c-0948ac2786d5', 'bef61231-53dc-4a6d-a5b3-6024cdc5df62', '4fa74d53-618f-4ff7-bfdc-faa20dfa4f5b'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:29 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:36:29 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:29 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:36:29 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Deleted volume successfully. Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-5ce8d1cc-82e9-4d51-9dc4-54effab8f996 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-b7adcdc9-4200-4f6b-a8ab-af1610aea3e9-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-e6c9352f-7562-4d77-ae31-14e93cd38368-delete_volume" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-e6c9352f-7562-4d77-ae31-14e93cd38368-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" by "delete_volume" {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" acquired by "delete_volume" :: waited 0.015s {{(pid=87600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbc4d7-8bc7-48ed-97c0-612efa190db9]: (4, 'qcow2') {{(pid=88564) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:29 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 Jul 14 20:36:29 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:29 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368" returned: 0 in 0.366s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:29 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:29 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368 Jul 14 20:36:29 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:30 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf/volume-e6c9352f-7562-4d77-ae31-14e93cd38368" returned: 0 in 0.246s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-quobyte-e6c9352f-7562-4d77-ae31-14e93cd38368" released by "delete_volume" :: held 0.650s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.quota [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Created reservations ['cefabc5d-d2da-439c-8da2-8cf95b1aec6e', 'c18a3eac-b746-437f-9aeb-44cb2faafbd5', '5741672c-31b0-405a-adb8-736f6828bacb', '2edd20da-7dcf-4cac-9e49-f7af00350ba4'] {{(pid=87600) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc': None} {{(pid=87600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.volume.drivers.quobyte [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e721cf2-e839-4ae3-869e-1107183fb4dc'] {{(pid=87600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.lockutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 20:36:30 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf Jul 14 20:36:30 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 20:36:30 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG oslo_concurrency.processutils [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/51e4bdc7547532f53600c3c7f9ceaaaf" returned: 0 in 0.232s {{(pid=87600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.manager [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Notifying Schedulers of capabilities ... {{(pid=87600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 20:36:30 devstack cinder-volume[87600]: INFO cinder.volume.manager [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Deleted volume successfully. Jul 14 20:36:30 devstack cinder-volume[87600]: DEBUG cinder.coordination [None req-23628600-609e-4099-8aeb-59b24dcd6e46 tempest-SnapshotDependencyTests-1396466980 None] Lock "cinder-e6c9352f-7562-4d77-ae31-14e93cd38368-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87600) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 20:36:40 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 20:36:40 devstack cinder-volume[87600]: DEBUG dbcounter [-] [87600] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}